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(57) Abstract 

A computer-based information 
browsing device including a body; a 
sensor device that detects a position of 
an instrument along one direction and 
a force of the instrument on the sensor 
device; a set of sensors actuaUe by said 
instramenl, disposed on the body and 
configured to produce at least one state 
signal when at least one of the set of 
sensors is actuated by the instrument, a 
transducer circuit that converts the force 
and position of the instnmient on the 
sensor device into at least one transducer 
signal; and an output port which outputs 
the at least one signal and the at least 
one state signal to a computer which 
is a set of infonnaticm hosted thereon, 
the at least one transducer signal and 
die at least (me sensor signal forming 
at least one of a direction of movement 
command, a change of speed command, 
a jump to a specified locatioD command, 
and a bookmark command used by 
die computer to manipulate a displayed 
image of the set of information. 




FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCT on the front pages of pamphlets publishing interoationa] s^plications under the PCX. 



AL 


Albsab 


ES 


Spain 


IS 


Lesotho 


SI 


Slovenia 


AM 


AnnenJa 


n 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


AastrU 


FR 


Pnncc 


LU 


Luxenbovig 


SH 


Senegal 


AU 


Aostmlia 


GA 


Gabon 


LV 


Latvia 


SZ 


Swaziland 


AZ 


AzertHujtn 


GB 


United Ku^gdooi 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Haxcgovina 


GE 


Georgia 


MD 


Repoblic of Moldova 


TG 


Togo - . 


BB 


Bartttdos 


GH 


Ghana 


MG 


Madagascar 


TJ 


Ta.pktstan 


BE 


Belgium 


GN 


Gtticea 


MK 


Tbt fenner Yugoslav 


TM 


l^ntonenistan , 


BP 


Boikbui Paso 


CR 


Greece 




Repoblic of Mttxdonia 


. TO 


TMcy 


BG 


Bulgaria 


HU 


Huttgary 


ML 


Mali 


TT 


Tlrinidad and Tobago - " 


BJ 


Beam 


IB 


Irehod 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


. IL 


Israel 


MR 


Mant^ania 


UG 


Uganda 


BY 


BeUn» • 


IS 




MW 


Malawi 


US 


United &ates of America 


CA 


Canada 


IT 


bdy 


MX 


Mexico 


uz 


Uzbekistan 


CP 


Centra] African RepubBc 


JP 


J^tan 


NB 


Niger 


VN 


VirtNam 


CG 


Congo 


KE 


Kenya 


NL 


NetfaeHands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyi gy titan 


NO 


Norway 


ZW 


Zimbabwe 


a 


CAted*Ivoif« 


KP 




NZ 


New Zealand 






CM 


Ciincfooo 




Repobbc of Korea 


PL 


Poland 






CN 


China 


KR 


RepcbUc of Korea 


PT 


Pcrtoga] 






cu 


Cuba 


KZ 


Kazaksiaa 


RO 


Romania 






cz 


Czech Rcfmblic 


LC 


Saint tuda 


RU 


^ Russian Fedcratioo 






DB 


Germany 


U 




SO 


Sudan 






DK 


Denmaik 


LK 


SriLoDka 


SB 


Sweden 






BR 


Estonia 


LR 


Uberia 


SG 


Smgapoie 







wo ^9446 



PCT/SG97y00036 



1 



TTTT.E OF THK TWVEWTTON 

A BROWSING SYSTEM AND METHOD FOR COMPUTER INFORMATION 

RAgKGROUW h OF THE TNVENTTQN 
Field of t^h^ Tnyentiton 

The present invention relates to a computer hardware and 
software system including a computer input device that can be 
operatively coo&blned with several methods of display on a 
computer screen vinder software and hardware control for the 
purpose of browsing through documents stored in a computer. 
Specifically, the present invention facilitates the browsing 
of a document stored in a computer in such a way that it 
allows a rapid view of what contents are present and the 
organization of the material in the document, as well as rapid 
access to the items in the document involved. 

nescripiiinn of iihe Prior Art 

Currently, the method for viewing docvuaents stored in a 
computer is through a computer monitor screen. For documents 
that are longer/ larger than can be contained within one 
screen, a means is provided to scroll the document up and down 
or to j\imp to a particular point in the document (through the 
use of, for example, a "mouse* coupled with scroll bars at the 
edges of the document displayed on the screen or through the 
use of hypertext linXs) ♦ 

However, most pe pie do not find this a particularly 
convenient way to view a document, as compared with a book. 
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That this is true is evidenced in the fact that despite the 
fact that the computer has been in increasing use, there is 
not only no corresponding reduction in paper use, but an 
increase in paper quantity is required to print what is 
conveniently stored in a computer that can be seemingly easily 
and flexibly manipulated for viewing* Sometimes the printed 
version of the information involved is necessary, like in the 
case of printing a picture on a sheet of paper to be pasted on 
some surface (e«g., a wall), or in the case of the convenience 
of having a relatively light, hardy paperback book for reading 
in almost any possible situation and location, but there are 
times when a reader is quite happy to sit at a desk in front 
of a desktop computer or handle a notebook computer away from 
the desk, and yet the reader would still prefer a printed 
version of the document in a hand-held format. This is 
especially true in the case of looking through manuals, 
including software manuals, to understand how to operate a 
device or software application. The irony is that computer 
software packages usually come with thick and heavy manuals 
containing information which can easily be stored on a light- 
weight CD-ROM, and even if the manuals are sometimes dispensed 
in the form of a CD-ROM, more often than not people would 
print them out into a hard-copy format in order to facilitate 
reading. 

What is involved when one interacts with the printed 
material in a book is a subtle and complicated process. To 
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start with, material in a book is presented in a sequential 
order, with a continuity of material from page to page, and 
there is also a hierarchical structure in the material 
presented (as the material is organized into chapters, 
sections, subsections, etc.) because ideas in the material are 
related to each other in some kind of conceptual hierarchy • 
The human perceptual system inputs data in a secpiential 
manner, and after a book is read from the beginning to the end 
in a sequential fashion, the brain then recreates the 
conceptual hierarchy after viewing the material involved. 
However, very often one does not read a book (or input the 
material involved) from the begixming to the end because (a) 
one wants to have an overview of the material present; (b) one 
is searching for something of interest to him/her; or (c) one 
is interested in reading only portions of the book (in the 
case of, say, reading the manual to understand how to operate 
something) . in these cases, one browses through the subject 
book to find the material of unique interest to that reader. 

Two basic things are achieved in the browsing process. 
First, the browser has a glimpse of what are the contents of 
the book document. Second, the browser has an idea of 
approximately where the items of interest are so that the 
browser can (a) return to look for them later when needed, and 
(b) have an understanding of the relationships between the 
material currently being viewed and other material (i.e., an 
understanding of the hierarchical structure involved) . When 
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browsing a book document, many finger-operations are required 
of the browser in order to flip through the pages and. 
together with the inherent sequential order imposed by the 
pages, very quickly allow the browser to have an understanding 
of the nature, location and organization of the material 
involved. 

In the process of browsing through a book, one can perform 
the following operations: 

(a) flip through the pages at varying speeds depending 
on the level of detail at which one wishes to view the 
material in the book; 

(b) jump to the approximate location of the item of 
interest; 

(c) change the direction of flipping (forward or backward) 
very rapidly because 

(i) one would like to compare and contrast material on 
different pages, 

(ii) after juii5>ing to an approximate location of some 
items of interest one would like to find their exact 
locations , or 

(iii) one is unsure of where the item of interest is 
and is in the process of searching for it; and 

(d) mark the locations of some pages of interest that one 
may want to later return. 

All these operations are performed very rapidly with the 
fingers interacting with the flipping pages and with minimal 



WO9S/09446 



PCT/SG97/O0a36 



5 

unnecessary movements of the fingers and hands. Interestingly, 
a book/magazine with soft and flexible pages is harder to 
handle because more finger and hand movements are needed to 
brovse through it, while books with stiff pages can be 
browsed with almost no movement of the hand. 

In currently available methods of browsing through 
documents stored in a computer, e.g., the use of a mouse 
combined with scroll bars and buttons on the computer screen, 
more movements of the hands are necessary to effect the 
various operations described above. Also, fine control of the 
hand or fingers (depending on whether the mouse uses hand 
movement to move the cursor on the screen or finger movement 
like in the case of a track ball) is necessary to position the 
cursor on the screen at the required places. The process is 
both lengthy and clumsy. The lengthiness of the process taxes 
the human short term memory's edsility to remember items 
encountered in the recent past for the purpose of establishing 
the relationships between items and the clumsiness of the 
process creates distraction and Interferes with the short term 
memory process, a well knovm effect in perceptual psychology. 

Because material in a book is organized into pages, it 
also enhances the ability of the reader to better remember the 
location of various portions of the material involved. Also, 
unlike the process of scrolling through a document on a screen 
like what is normally done in a word-processor, wherein the 
contents become a blur and reading is impossible, when one 
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moves through the material in a book through flipping, one is 
still able to read at least the approximate contents, if not 
the details, it is due to these features that a person 
browsing through a book can acquire a good understanding of 
its contents, the location of specific items and organization 
of the material. 

It is because of the reasons set forth above, people 
still prefer to read a book in their hands, rather than a 
document image displayed on a computer screen using currently 
available methods. 

U.S. Pat. No. 5,467,102 (Kuno fit, fll ..) discloses a device 
for document viewing that consists of two display screens, one 
of the purposes of using two display screens is to allow the 
user to display two different pages from the document so that 
they can be read side-by-side (e.g., a diagram and its textual 
explanation) . Another purpose is to allow a large picture to 
be displayed simultaneously on both pages. The Kuno et 
device allows users to change the speed of movement through 
the document through a pressure sensor — the more pressure 
applied, the faster the pages in the document are moved 
through. The Kung et al. device also allows the document to be 
viewed in the forward or backward direction by pressing on a 
forward sensor area or a reverse sensor area respectively, one 
can also select a page to jump to by pressing 6n an icon 
displayed on the screen. However the Kuno et ^^ device still 
does not provide the same convenience as browsing through a 
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book, primarily because when switching between the operations 
for different controls ~ the speed of movement through the 
document, the change of direction of viewing, and the jumping 
to different parts of the document — there are a lot more 
hand and finger movements than is the case in manipulating a 
physical book. Moreover, the Kuno et-. a] , device is a 
specialized, relatively costly device with sensors and 
hardware built onto two display screens, whereas the present 
inventor recognizes that a lower cost and more practical 
device would be one that adds modularly to the existing 
computer system* 

Cuxrrently, there are also computer mice that can 
eliminate the above-mentioned problem of positioning cxirsor on 
the computer screen with a conventional mouse (i.e., fine 
control of the hand or fingers is needed) • These mice allow 
the user to specify "hot locations" on the screen on which the 
cursor 'homes onto" with less fine control than conventional 
mice. Furthermore, a subset of these mice can generate 
"vertical only" or "horizontal only" movement of the cursor so 
that the scrolling process requires less fine control of the 
muscle than is required with a conventional mouse. These mice 
eliminate some, but not all, of the problems associated with 
the conventional methods of computer input as far as con^uter- 
based document browsing is concerned. 

In U.S. Patent No. 5,417,575 (1995) McTaggart discloses 
an electronic book that comprises laminated sheets bound 
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together in the fom. of a book. On each of these sheets, 
printed material is arranged on the top layer and below that 
layer is an electronic backdrop containing thin light-emitting 
diodes (LED's) and pressure sensitive switches affixed onto a 
backing sheet. The LED's generate visual signals that can be 
seen through the top layer for the purpose of highlighting 
parts of the printed material. The pressure switches, 
positioned under certain items in the printed material, are 
for the purpose of sensing the user's selection of those 
items. A speaker is also provided on the book to generate 
audio signals for explaining the text or giving the user audio 
feedback. Contact or photo-sensitive switches are also 
embedded in the pages to allow the electronic circuits to know 
which pages are currently being viewed, so that the 
appropriate audio and visual signals can be generated. Even 
though this apparatus is in a form that allows a person to 
handle it like handling a typical book, with visual and audio 
enhancements of the printed material as well as facilities 
that accept the user's feedback, it is basically a hard-wired 
device that is not reprogrammable and different hardware has 
to be configured for books with different contents. No 
provision is available for downloading document files from a 
computer for display on the electronic book nor is the 
electronic book able to display any arbitrary document file. 
This device is hence not suitable for browsing through 
docxunents stored in a computer. 
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Therefore, the inventor has identified there exists a 
need for a low-cost, modular device that can be connected to 
existing computer systems and that permits easy, effective 
computer-based document browsing that approaches that of 
browsing through a book. 

SUHHARY OF THE TNYMTTON 
In view of the aforementioned short-comings of presently 
available schemes for browsing through documents stored in a 
computer, one objective of the present invention is to provide 
a browsing device that exploits the use of finger operations 
normally involved in browsing through a book, namely, the change 
of speed of movement through the document involved, the change 
of direction of movement through the document, the jumping to 
other portions of the doctiment, and the bookmarking of pages 
(e.g., when a page is bookmarked, it can be returned/ j tamped to 
later very quickly by using the controls operated by the 
fingers) • 

Another objective of the invention is that the positioning 
and design of the controls for the above-mentioned operations 
performed by the fingers are such that they allow almost no 
movement of the hand and minimal movements of the fingers, thus 
maximizing the ease of browsing through the stored document. The 
dexterity of the human fingers is to be fully exploited for these 
controls. 
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A further objective of the invention is to provide a low 
cost, modular browsing device that can be easily attached to 
existing computer systems much like how a mouse attaches to a 
coo^uter system. 

still a further objective is to provide a reconf igurable 
construct for the browsing device so that it can be (a) 
configured into a hand-held controller; (b) attached to the sides 
Of existing computer screens; (c) configured to cooperate with 
a mouse so that there is no need to move the user's hand(s) when 
switching between browser-related operations and mouse-related 
operations; and (d) configured to cooperate with a gyro-mouse 
so that the entire assembly can be used in the absence of a table 
top. The method is chosen by the user depending on his/her 
preference. 

Another objective of the invention is to provide a means to 
display, on the computer screen, the document to be browsed 
through using the browsing device. The display is in the form 
of a computer book together with showing the thicknesses of 
material in the docuBent before and after the currently viewed 
material, showing of the bookmarks, and showing, on the 
thicknesses, of the location of the pages that would be jumped 
to at any given time if jumping were to be effected. 

Another objective of the invention is to provide the 
following five methods of organizing the material in the document 
and corresponding display formats: (a) organized into pages and 
can be flipped through page by page from right to left or vice 
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versa, much like what happens when one flips through a book; (b) 
organized into pages and can be flipped through page by page from 
bottom to top or vice versa, much like what happens when one 
flips through a notepad; (c) organized into pages and slid 
through page by page from right to left or vice versa, much like 
what happens when one views a microfilm; (d) organized into pages 
that can be flashed one after another; (e) organized so to be 
scrolled through, with no distinct page boundaries, much like 
what is normally done in a word-processor. The first three 
methods incxir more cost in terms of storage space and processing 
time, but when used together with the aforementioned browsing 
device result in a browsing process that most resembles that of 
browsing through a book, a notepad, or a micro-film. The last two 
methods demand less storage space and reduced processing time, 
and even though these two methods do not precisely emulate the 
book-browsing process, they can still benefit from the rapidity 
of finger control effected on the browsing device. 

Another objective of the invention is to provide 
sijaizltaneous multiple indexing in conjunction with the inventive 
browsing system. When a keyword of interest is encountered during 
the reading of the document, the user selects it using a cursor 
on the screen in conjunction with a pointing device such as a 
mouse, like what is normally done in current computer systems, 
or using his/her finger in conjunction with a touch or pressure 
sensing screen, or other methods. In response, the pages on which 
explanations or other issues related to this keyword reside are 
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book».ar)ced by the inventive system, after which the user can 
quickly flip to one of these pages using the mechanisms provided 
in the browsing system. 

Another objective of the invention is to use the above- 
mentioned browsing facility in conjunction with other software 
that can reorganize the material in the document involved to 
facilitate browsing/viewing - for example, the positioning of 
material for comparison side by side on the pages currently being 
viewed. 

Another objective of the invention is to use the above- 
mentioned browsing facility in conjunction with software that can 
highlight selected portions of the material or annotate on the 
pages i„ the document involved to facilitate 
browsing/ viewing/reading . 

Yet another objective of the invention is to provide the 
above-mentioned browsing facility to a word processor to 
facilitate the entering, processing, and viewing/ browsing of 
material in a word processor. 

Another objective of the invention is to provide the above- 
mentioned browsing facility to any software in which information 
cannot be fitted within one computer screen for viewing or 
manipulating. 

Yet another objective of the invention is to provide a new 
metaphor - the "library metaphor' - to the computer operating 
system s human interface in which information on the computer 
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screen which is traditionally presented in the form of windows 
can now be presented in the form of 'books". 

The above-mentioned objects can also be achieved by 
providing a browsing device for browsing through document that 
includes, a top surface, a sensor surface and a bottom surface. 
A sensor area on the sensor surface detects the position of a 
finger along one direction and the force of the finger on the 
sensor area. The browsing device also includes four buttons/ on- 
off switches on the bottom surface, and four additional 
buttons/ on-off switches on the said top surface, each of which 
is operated by the fingers. An electrical circuit converts the 
force and position of the finger on the sensor area as detected 
by the force and position sensors on that area into electrical 
forms and outputs them. The electrical circuit also outputs the 
on/off states of the four buttons /on-off switches on the bottom 
surface, and four additional buttons/on-off switches on the said 
top surface. 

BRTRP nRfirPTPTTOM nv Tm npAWTWftR 
A more complete appreciation of the invention and many of 
the attendant advantages thereof will be readily obtained as the 
same becomes better understood by reference to the following 
detailed description when considered in connection with the 
accompanying drawings, wherein: 
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FIG. lA is th block diagram of the browsing device 
according to the present invention, detailing input commands and 
output signals. 

FIGS. IB and xc are a schematic perspective view (upper and 
lower view respectively) of a first embodiment of the browsing 
device. 

FIGS. 2A and 2B are top/bottom perspective views of the 
browsing device configured into a minl-booic configuration used 
in conjunction with a computer. 

FIG. 2c is front perspective view of the browsing device 
configured into a screen configuration used in conjunction with 
a computer. 

FIG. 2D is a front perspective view of the browsing device 
configured into a aouse cojrflgruratlon used in conjunction with 
a computer. 

FIG. 2E is a front perspective view of the browsing device 
configured into a gyro-«ouse configuration used in conjunction 
with a computer. 

FIG. 2P is a front perspective view of the browsing device 
configured into a one-hand configuration used in conjunction with 
a computer. 

FIG. 20 is a front perspective view of the browsing device 
configured into a one-hand-gyro-mouse configuration used in 
conjunction with a computer. 
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FIG. 3 is a top perspective view of a computer book 
displayed on a screen that is to be browsed through using 
browsing device of the present invention. 

FIG. 4 (shown as Figures 4A and 4B) is a flowchart that 
details the mechanisms for jumping to other parts of the document 
being viewed/ browsed through and movement through a docvunent 
under the control of the thumb on the browsing device of present 
invention. 

FIG. SA is an top perspective view of the computer book of 
the present invention that uses a flipping method of moving 
through a docximent. 

FIG, SB is a top view of the computer book of the present 
invention that uses a sliding method of moving through a 
document. 

FIG. 5C is a top view of the computer book of the present 
invention that uses a flashing method of moving through a 
document. 

FIG. 5D is a top view of the computer book of the present 
invention that uses a scrolling method of moving through a 
document. 

FIG. SB is a top perspective view of the computer book of 
the present invention that uses a vertical flipping method of 
moving through a document. 

FIG. 6A is a top perspective view of an open fan display for 
displaying pages and that is used in conjunction with the 
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flipping method of moving through the document illustrated in 
FIG. 5A. 

FIG. CB is a top perspective view of a collapsed fan display 
for displaying pages and that is used in conjunction with the 
flipping method of moving through the document illustrated in 
FIG. 5A. 

FIG. 7 is a schematic block diagram of the browsing system 
that incorporates the inventive browsing device of fig. IB. 

PIG. 8 is a schematic electrical block diagram of the 
browsing device of FIG. IB. 

PIGS. 9A-9C are schematic perspective views of another 
embodiment of the browsing device that uses many thin, hard, and 
flexible pieces of material bound together in the manner of the 
binding of the pages of a book. 

PIGS. lOA and lOB are top/bottom schematic perspective views 
of another embodiment of the browsing device that uses a display 
screen fitted to a slanted surface to display a material 
thicknesses before or after currently viewed material. 

FIG. iiA is a comparative schematic diagram of 
directories/ sub-directories in a 'window" compared with pages of 
a con?)uter book that uses the flipping method of FIG. SA in order 
to move through the book. 

FIG. iiB is a comparative schematic diagram of 
directories/ sub-directories and the files in a "windows" system 
compared with chapters and sections in a computer book that uses 
the flipping method of FIG. SA to move through the book. 
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FIG. lie is a comparative schematic diagram of working 
windows in a "windows" system compared with pages of a computer 
book that uses the flipping method of FIG^ 5A to move through the 
book. 

FIG* 12 is a flowchart of a method for displaying a set of 
information on a display screen as controlled by a browsing 
device • 

FIG. 13 is a flowchart of a method for browsing a set of 
infoziaation on a display screen. 

FIG. 14 is a flowchart of a user-interface method according 
to the library metaphor aspect of the present invention. 

DESCRIPTION OF THE PREFERRED EMBODTMRWTS 

Referring now to the drawings ^ wherein like reference 
numerals designate identical or corresponding parts throughout 
the several views, and more particularly to FIG. lA thereof vrtxich 
depicts the browsing device 100 according to the present 
invention that can be used in conjunction with existing computer 
systems for the purpose of browsing through documents or any 
information stored in the computer. Four commands are input and 
detected by the browsing device 100. These commands include the 
following: (a) specifying whether a movement in a forward 
direction or in a backward direction through the document is to 
be performed; (b) specifying a speed of the movement described 
in (a) ; (c) jumping to a specified location in the docximent or 
information involved; and (d) specifying that certain portions 
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of the document or the information involved is to be bookmarked. 
Based on these commands, signals are generated and output to 
effect the necessary operations in a computer system (e.g., 
computer 205 in FIG. 2A) attached to the browsing device 100. 

PIGS. IB and ic depict one embodiment of the primary 
browsing device lOO according to the present invention. The 
browsing device lOO consists of a slanted surface 120, extending 
from a top surface lio of the browsing device loo. The slanted 
surface 120 supports a user's thumb 122 on which to rest, 
although the user may use another instrument or finger as well. 
During operation, four other fingers 141 - 144 are placed on a 
bottom surface 130 of the device, opposed to the thumb 122. On 
the slanted surface 120 a set of force and position sensors 
disposed in a sensor area 121 (sensors such as an appropriately 
customized version of Interlink electronics Thin-film Linear 
Potentiometer Part Number 360) detect (a) a force of the thumb 
122 on the slanted surface 120 within the sensor area 121 and (b) 
the position of the thumb 122 (or one of the other fingers) in 
the sensor area I2l in the direction of the slant. Henceforth 
the direction of the slant is referred to as an x-direction, as 
shown in PIG. IB, where the positive x-direction points away from 
the edge that adjoins the top surface 110 and the slanted surface 
120. The position of the thumb 122 (or one of the other fingers) 
in the y-direction (a direction perpendicular to the x-direction 
on the slanted surface 120) gauges whether the thumb 122 remains 
on the sensor area 121. 
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Four buttons /switches 131-134 are placed on the bottom 
surface 130, within easy reach of the four fingers (141 - 144) 
during those operations %^en these fingers (141 - 144) are placed 
on the bottom surface 130* On the top surface lio of the device 
100, another four buttons/ switches (111 - 114) are placed, 
preferably parallel to the edge adjoining the top surface 110 and 
the slanted surface 120, as shown in FIG. IB. 

The force of the thumb 122 (or one of the other fingers) on 
the sensor area 121 dictates how fast to move through the 
document, and the position of the thumb 122 (or one of the other 
fingers) along the x-direction dictates the point to which the 
document is jtimped. More particularly, the buttons (131 - 134, 
and 111 - 114) on the bottom (as shown in Figure IC) and top 
surfaces (130 and 110 respectively) are for the purposes of 
boo)aDar)cing. The use of these buttons (131 - 134, 111 - 114) 
depends on the pairticular configuration in which the browsing 
device 100 is used and will be described below* 

FIGS. 2A - 2G depict alteimative conf igvirations to employ 
the browsing device 100 for producing the browsing input. The 
browsing device 100 depicted in FIG. IB is preferably used with 
an operator's right hand. A left-hand version of the browsing 
device 101 as depicted in FIGS. 2A and 2B (where Figure 2B shows 
a bottom side) is employed in some of the embodiments depicted 
in FIGS. 2A-26. 

FIG. 2A depicts one embodiment of the mini-book 
configuration 200 in which a left-heind version lOl and a right- 
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hand version loo of the browsing device loO are joined back-to- 
back through latching xnechanisms 151 and 152 as shown in FIG. ic 
and the resulting assembly 200 is electrically operatively 
connected to the computer 205 (such as an IBM Aptiva A92, Part 
Number 42H0333) . In operation, the left and the right hands 
operate the devices on the left and right respectively, hence the 
left thumb 172 and right thumb 122 rest on the left and right 
sensor areas (171 and 121) respectively. The other four fingers 
of both hands are placed near the buttons (I3i - 134, lai - i84) 
on the bottom surfaces 130 and 180 of both the left and right 
devices, m this configuration, the buttons (ill - 114, I6I - 
164) on top surfaces 110, I60 are available for auxiliary 
functions. 

In this configuration, the direction of movement (i.e., 
forward or backward) through the document (using flipping or 
other methods, all to be described in detail later) is effected 
through the force applied by the right and left thumbs (122 and 
172) on the sensor areas 121 and 171 respectively. The right 
thumb 122 force activates a forward movement through the document 
and the left thumb 172 force activates a backward movement. The 
speed of movement is preferably proportional to the force 
applied, although other force/speed relationships may be employed 
successfully. The right thumb 122 operating the right sensor 
area 121 activates jumping to points in the document involved 
that lie between the currently viewed material in the document 
and the end of the document and the left thumb 17l operating the 



WO9S/09446 



PCT/SG97/00036 



21 

left sensor area 172 activates jumping to points in the document 
involved that lie between the currently viewed material in the 
document and the beginning of the document. The right fingers 
other than the thumb 122 operating the buttons 131 - 134 on the 
bottom surface 130 create bookmarks for points in the document 
involved that lie between the currently viewed material in the 
document and the end of the document and the left fingers other 
than the thxmb 172 operating the corresponding buttons 181 - X84 
on the corresponding bottom surface 180 create bookmarks for 
points in the document involved that lie between the currently 
viewed material in the document and the beginning of the 
document. 

An x-direction is defined along the slanted surface for the 
left-hand device XOl that is perpendicular to the edge adjoining 
the top siurface 160 and the slanted sturface 170 of the left-hamd 
device 101 and the positive x-direction is taken to be the 
direction away from that edge as illustrated in FIG 2A. The 
operations to be described below for the sensor areas 121 or 171 
and for the buttons on the bottom surfaces 131 - 134 or 181 - 184 
are similar for both the right-hand device 100 and the left-hand 
device 101 and unless necessary, only the operations for the 
right-hand device 100 will be described. 

The position of the thumb 122 in the x-direction on the 
sensor area 121 (refer to FIG. IB) as detected by the position 
sensors on the slanted surface 120 determines the page in the 
document to jump to (for the cases 'in which the material in the 
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document is organized into pages to be flipped, slid or flashed 
on the coTaputer screen, the details of which will be described 
later) or the point in the document to jump to (for the case in 
which material in the document is not organized into pages like 
in the case of the use of scrolling to move through the 
document). Let x = 0 (the origin) be the point at which the 
slanted surface 120 meets the top surface lio. The thumb 122 
will be referred to as being "at" position xl rtxen it covers the 
point xl and some contiguous points to the "right" of xl, i^e., 
some of the contiguous points x such that x > xl, and "right" 
refers to the conventional positive axial direction. This is 
becaixse the intersection of the thumb 122 and the slanted surface 
120 (in the sensor area 121) on the browsing device 100 has a 
small spatial extent and hence it will have some dimension in the 
x-direction. 

FIG. 3- shows the "book" 300 displayed on the computer 
screen, henceforth referred to as the computer book. When using 
the current embodiment of the browsing device 100, in order to 
allow the user to have an idea of the thickness of the computer 
book 300 on both sides, so that the user can have a good idea of 
the approximate location of the currently viewed pages in the 
document involved, the thickness 310 of the computer book 300 on 
both sides is shown on the computer screen next to the displayed 
pages 301 as shown in FIG. 3. 

In the browsing of a real book, the thumb selects the page 
to jump to by sliding along the side until it reaches that page. 
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In the process of accomplishing this, the thumb slides along the 
side of the book in a direction perpendicular to the edge of the 
book the thumb is touching (similar to the x*-direction in FIG. 
IB) by an amount proportional to how far along in the document 
the page to be jump to is from the current page* Because in the 
browsing device 100 depicted in FIG. IB, the width of the slanted 
stir face felt by the thumb does not change, even as the amount of 
material/number of pages present on that "side* of the "book" 
changes, the translation of the x*^position of the thumb to a page 
in the document to jump to is slightly more complicated. 

Consider initially no force is applied onto the sensor area 
X21 by the thumb 122 and a certain page of the document involved 
is being displayed. When the thumb 122 is placed at any position 
X a XTl on the sensor area 121 and %^en a force is applied for 
a time longer than a user*-specif ied pre-defined, short period, 
preferably, but not limited to, a range of 100 milliseconds to 
1 second, the document is moved through forward (or backward if 
the left sensor area 171 is activated by the thumb 172} • The 
speed of movement is proportional to the force applied* If the 
force is applied only momentarily, (e.g., less than preferred 100 
millisecond) no movement through the document takes place, but 
a starting position for any subsequent jumping process is taJcen 
to be XTl. When the thumb 122 is moved from x = XTl to a 
position XT2 (XT2 > XTl) and the thumb 122 is pressed 
momentarily, a jimp is made to a page in the document that is 
further along. Let XS be the width of the sensor area 121 and 
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let PR be the number of pages remaining from the current page to 
the end of the document (or to the beginning of the document, if 
the left device 101 is activated) . PJ, the number of pages to 
skip over is equal to PR * (XT2 - XTl) / (XS - XTl) . That is, 
at any given time, the distance along the slanted surface from 
the current thumb position XTl to the edge, XS, is treated as 
being proportional to the number of pages remaining from that 
point to the end or beginning of the document. In the case of 
using the method of scrolling to display the document in which 
the material is not organized into pages, then PR becomes the 
amount of material, say the number of lines of material, 
remaining and PJ becomes the amount of material to be skipped 
over. 

After the thumb 122 moves from the starting position XTl in 
the positive x-direction, before it applies any force to effect 
a jump, it is at liberty to move between XTl and XS in the 
positive or negative x-directions to search for a page it wishes 
to jump to. If in this process the thumb 122 moves in the 
negative x-direction beyond the starting position XTl, whatever 
new position the thmnb 122 finds itself in and after having 
applied a momentary force in that position, that position will 
become a new starting position XTl for the computation of any 
subsequent jump. If the thumb 122 did not apply any momentary 
force after having moved in the negative x-direction beyond the 
starting position XTl, and then it moves back past XTl in the 
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positive x-direction, the starting position for any subsequent 
jump will be XTl. 

When one continues to apply force for longer than the user- 
defined pre-defined, short time period on the sensor airea 121 
using the thumb 122 after a jump is made while holding the thumb 
122 at the same position , the movement through the document 
begins from that page/ point onwards, and the speed of movement 
is proportional to the force applied as before. 

The starting position of the thumb 122 for the jumping 
process can be at x = 0 or any position XTl in the x-direction. 
But starting at x = 0 allows the use of a larger width (from x 
= 0 to XS) to correspond to the remaining material and thus a 
better resolution of control in terms of jxmping/ skipping. At 
any given time, no matter how much remaining material there is, 
while one is moving through the document by having the thumb 122 
at a given position, one can always move the thumb 122 back to 
a position of smaller x (that does NOT trigger a movement through 
the document in the opposite direction — one has to use the 
other device operated by the other hand to change direction) or 
X « 0, and apply some force momentarily to signify that the user 
has now repositioned the thumb 122. The user may then continue 
the process of moving through the document by applying the force 
longer than a pre-defined, short moment, or use this current 
position as a new reference/ starting point (XTl) and slide the 
thumb 122 to a new position (XT2) to skip through some material. 
The movement of the thumb 122 back to a smaller x or x = 0 to 
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define a starting position XTl before the jumping process gives 
the user a better resolution for the jumping/skipping control. 

The mechanisms for jumping to some other parts of the 
document and movement through the document under the control of 
the thumb 122 as described above are described in the flowcharts 
in FIGS. 4A and 4B. 

Consider initially a certain page of the document is being 
displayed, in step 401, the thumb 122 is placed at position XT 
on the sensor area 121. The process flows to step 402, where a 
check is made if a force has been applied momentarily or longer 
(than a predefined, short time). If not, nothing happens; the 
thumb 122 may move to a new position XT (step 403) or stay in the 
same position XT. If an affirmative response is received in step 
402, a check is made to see if the thumb has applied the force 
longer than momentarily, if so, the process flows to step 405 
where movement through the document is initiated (with a speed 
proportional to the force applied and a direction depending on 
whether the left-hand device 101 or the right-hand device 100 in 
the mini-book configuration 200 is activated), if a negative 
response is received in step 404, the process flows to step 406. 
Similarly, after initiation of movement through the document in 
step 405, the process also flows to step 406. In step 406, the 
starting position XTl is assigned the value of the current thumb 
122 position XT. The process then flows to step 407 where the 
thumb 122 either stays in the current position or moves to a new 
position XT (<> XTl). The process then flows to step 408, where 



wo 98/09446 



PCT/SG97/00(I36 



27 

a check is made to find out whether XT is greater than XTl. If 
so, a check is made in step 409 to find out whether a force is 
applied at XT; if not, nothing happens and the thumb may move to 
a new position XT (<> XTl) in step 407, If the response to step 
409 is affirmative, the process flows to step 410, where XT2 is 
assigned the value of the current XT. The process then flows to 
step 411 where a value PJ = PR*(XT2 - XTl) / (XS - XTl) is 
computed. (PR is the nximber of pages or amount of material 
remaining from the current page to the end of the document if the 
right-hand device 100 in the mini-book configxiration 200 is now 
being activated or from the current page to the beginning of the 
document if the left-hand device no in the mini-book 
configuration 200 is being activated. XS is the width of the 
sensor area 121.) A jump is effected that skips over PJ pages 
or PJ amount of material in the document. The process then flows 
back to step 401 where the process repeats. 

If in step 408, XT is found to be smaller than XTl, then the 
process flows to step 412 which checks if a force has been 
applied at XT momentarily or longer. If not, nothing happens, 
the process flows to step 407 where the thumb can move to a new 
position XT. If so, step 413 checks to see if the force applied 
is longer than a pre-defined, short period. If the force applied 
is longer than a pre-defined, short period, the process flows to 
step 414 where movement through the document is initiated (with 
a speed proportional to the force applied and a direction 
depending on whether the left-hand device loi or the right-hand 
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device 100 in the mini-book configuration 200 is activated) . if 
a negative response is received in step 413, the process flows 
to step 406 Where the starting position XTl is assigned the 
current value of XT. After the initiation of movement through 
the document in step 414, the process also flows to step 406. 

The above described method of jumping /skipping through the 
pages through the use of the sliding of the thumb 122 over a 
certain distance (in the x-directlon) is referred to as the 
relative distance method whereas the jumping/ skipping in the 
process of browsing through a physical book uses absolute 
distance (i„ the direction perpendicular to the edge of the 
book) . Another embodiment of the browsing device looo that uses 
absolute distance will be described later in reference to PIG. 



10. 



To provide the user with feedback of his/her thumb movement 
on the sensor area 121 along the x-direction (Pig. ib) before 
he/she effects the jump to a different part of the document 
involved, an indication of the position of the thumb 122 is 
provided on the thickness 310 area of the book 300 displayed on 
the screen next to the pages 301 currently being viewed (pig. 3) . 
Recall that the thumb 122 starts from one point on the sensor 
area 121 and slides on the sensor area 121 in the x-direction 
before a force is applied to effect the jump, m this process, 
the thumb 122 Slides over many points on the x-position sensor 
121 on the Slanted surface 120. An indication is made on the 
computer screen of the location of the page that would be jumped 
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to had the thiimb 122 applied a force at any given point along the 
x-direction. As the thumb 122 slides on the sensor area 121 
before the application of the force, the whole width of the 
thickness 310 displayed on the screen next to the currently 
viewed pages 301 is preferably divided into two parts. One part 
corresponds to all the pages that will be skipped if a force were 
applied at that point in the x-direction on the sensor area 121 • 
The other part corresponds to the pages that remain from the page 
jumped to if a force were applied to the end of the document (if 
one is moving forward through the docximent and the right hand 
device 100 in the mini-book configuration 200 is being activated) 
or to the beginning of the document (if one is moving backweard 
through the document and the left-hemd device 101 in the mini- 
book configuration 200 is being activated) . There are two ways 
to display the boundary (a thin line) between these two parts 
that corresponds to the point or page in the document jumped to 
if a jump were to take place. Preferably within the thickness 
area 3io on the computer screen is shown by the boundary, a thin 
line, as being different in darkness, texture, or color 
(preferably darkness) fxrom the rest of the thickness 310 - hence 
one would see a line oriented perpendicular to the x-direction 
(parallel to the y-direction, PIG. IB) and whose length is 
confined to the thickness 310 region moving in the positive or 
negative x-direction depending on the direction of movement of 
the thumb 122 on the sensor area 121. Alternatively, one part, 
say the left part, is shown as being different in darkness, 
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texture or c lor (preferably darkness) from the other part, say 
the right part - hence one would see one part expanding and the 
other contracting, or vice versa, depending on the direction of 
movement of the thumb 122 on the sensor area 121. 

The use of the four buttons 131 to 134 on the bottom surface 
130 of the browsing device lOO will be described for boolanarking. 
During operation, each of the other four fingers 141 to 144 
except the thumb 122 is placed near each of the four buttons 131 
to 134 and each of these buttons is meant to be operated by the 
finger nearest to it. At any moment when one is viewing a page 
of the document and decides that it might be of interest to 
return to later, one presses one of the buttons 131 to 134 
momentarily and then lets go, either once or twice, depending on 
whether one wishes to create a finger- bootanarJc or a perTnanent- 
boolaaark respectively as will be described below. The page will 
then be bookmarked and a bookmark 320 is displayed on the screen 
as shown in FIG. 3 - sticking out from the position of the 
page/point that it marks on the side of the book 300. one can 
use the same button (one of the buttons 131 to 134) to bookmark 
more than one point/page. All the bookmarks 320 that are created 
by the same button (i.e., one of buttons 131 to 134) are 
clustered together (e.g., one of clusters 361 to 364) and 
displayed as such as shown in FIG. 3. 

After one has bookmarked a certain page/point on a certain 
side (right, 371, or left, 372, FIG. 3) of the book, if one moves 
through the document past that page/point (forward or backward 
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respectively) , the bookmark will eith r disappear or be 
transferred to the other side, depending on whether the bookmark 
is a finger-bookmark or a permanent-Jt)ooJciDar/c respectively. The 
finger-bookmarks are more like the bookmarks created by the use 
of the fingers when browsing through a physical book - they are 
more temporeury and they "disappear* after the boolmarked 
page/point has been passed. In the case of a page/point marked 
by a peznnanent-bookmark, when the page/point is passed the 
bookmark will be transferred to the other side and be grouped in 
the cluster that corresponds to the same cluster in the other 
side from which it originates. (The preferred method by which 
this transfer is to be effected and shown on the computer screen 
depends on the method of movement through the docximent which will 
be described later together with the description of those 
methods) . To remove a permanent-bookmark, one presses the 
corresponding button twice in quick succession (e.g., "double 
click") when the bookmarked page/point is currently in view. 
(The permament bookmarks are more like the bookmarks created by 
inserting, say, a slip of paper when one is browsing through a 
physical book.) The finger-bookoarks and the permanent-bookmarks 
are displayed differently on the computer screen. (They are 
differentiated either by shape, size, color, marking, or 
lettering.) 

For the finger-bookmark, if one wishes that the bookmark not 
be removed after one has moved through the document past the 
corresponding page/ point, one can transfer it to the other side 
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by creating another bookmark using the fingers on the other hand, 
much like what one does when browsing through a physical book. 
The permanent-bookmarking process tends to create many bookmarks 
and they should be used only if necessary. 

To return to a bookmarked page/point (whether it be finger- 
bookmarked or permanent-bookmarked) , one presses the button (one 
of X31 - 134 or one of 181 - 184) that corresponds to the cluster 
to trtiich the page/point belongs and uses the corresponding thumb 
122 or 172 to apply force to the corresponding sensor area 121 
or 171 vrtiile continuing to press the button. If there is more 
than one bookmarked page in each cluster, the page that is 
nearest the current page will be jumped to. (Note that this can 
obliterate some finger-bookmarks in the other clusters if in this 
process the document is moved through past those corresponding 
pages.) After having jumped to a bookmarked page, if one wishes 
to take some time to read that page, one has to stop applying 
force using the thumb 122 or 172 on the corresponding sensor area 
121 or 171 or else the process of moving through the document 
will begin. One should also stop pressing the corresponding 
button (one of 131 -134 or one of 181 - 184). (This is to 
relieve the finger of unnecessary tension) . If this page was a 
finger-bookmarked page and one wishes to bookmark this page 
again, one has to press the button (one of 131 - 134 or one of 
181 - 184) again (once or twice depending on whether now one 
wishes to finger-bookmark or permanent-bookmark it respectively) . 
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To avoid confusion and speed up the browsing process, even 
though the facility of using one button to bookzoark laore than one 
page is provided, hence creating the cluster of bookmarks 
associated with that button, it is to be avoided if possible. 
Hence, one should try to use as many of the buttons (131 - 134 
and 181 - 184) provided as possible, Hiat is, if there are four 
pages to be bookmarked on one side, one should use all £o\ir 
buttons (131 - 134 or 181 - 184, depending on whether it is the 
right side 371 or left side 372 respectively that is involved) , 
creating only one bookmark in each clxister. This way, a speedier 
jump to a desired bookmarked page is possible because one does 
not have to jump through those unwanted pages bookmarked in the 
same cluster before one arrives at the intended page. 

At any given time, only one of the hands is supposed to 
perform operations (i.e., only one of the two browsing devices 
100 and 101 is supposed to be activated) . If both hands try to 
perform operations at exactly the same time, there will be no 
operation performed. If one hand performs an operation before 
the other hand, then that hand takes priority. One exception to 
this is when the device is used in conjunction with a flipping 
method 500 or 540 of moving through the document involved to be 
described in detail later (with reference to FIG. 5A and FIG. 
5B) , whereby the operation of both hands is used to create a "fan 
display' 600 or 610 (with reference to FIG. 6A and FIG. 6B) . 

FIG. 2C depicts one embodiment of the screen configuration 
210. In this configuration 210, the operations are identical to 



wo 98/09446 



34 



PCT/SG97/00036 



that described above for the mini-book configuration 200 depicted 
in FIG. 2A, except now, in this configuration 210, the two 
browsing devices 100 and loi are separated and attached to the 
sides of a screen 216(such as an IBM Color Monitor G50, Part 
Number 96G1593) . This is achieved by first attaching these 
devices to a frame 215, and then attaching the frame 215 to the 
screen 216. This is done because the browsing devices 100 and 
XOl need to be firmly attached and we would like to use existing 
computer screens 21S and hardware with no necessity of any 
physical modifications to them. 

FIG. 2D depicts one embodiment of the mouse configuration 
220. m this configuration 220, two browsing devices loo and lOl 
are joined together in the same manner as in FIG. 2A and also 
mounted onto a mouse 22S (e.g., a mouse adapted from the IBM 
Enhanced Mouse II, Part Number 13H6714) . This allows the use of 
one hand for operating the browsing devices lOO and lOl as well 
as the mouse 225. The operation of the browsing devices 100 and 
101 is largely the same as that described for the mini-book 
configuration 200 except for the following observations. The 
mouse-browser configuration 220 is preferably placed on a flat 
surface like the top of a table, but not typically held in the 
hands. The four buttons 131 - 134 on the bottom surface 130 
(FIG. 2A) of the right-hand device 100 are now not primarily 
used, but instead the four buttons ill - 114 on the top surface 
110 replace the functions of the four bottom buttons 131 - 134. 
Similarly, for the left-hand device 101, the four buttons 161 - 
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164 on the top surface 160 replace the functions of the f ur 
buttons 181 - 184 on the bottom surface 180 (FIG. 2A) . The eight 
top buttons 111 - 114 and 161 - 164 are now operated only by the 
index finger which also operates the mouse buttons 226 and 227. 
For the operation of the left sensor area 172, the thumb of the 
same hand is preferably used. For the operation of the right 
sensor area 121, one of the other three fingers, normally the 
middle finger, is used. (For a left-handed, "southpaw*, this is 
reversed) . / 

FIG . 2B depicts one embodiment of the gyro-mouse 
configuration 230 (which includes an adapted gyro-mouse such as 
a GyroPoint® Desk from Gyration, Inc. of Saratoga, California, 
Part Number PA00038-001) . Currently, there is a type of mouse 
called the gyro-mouse that can be held in the hand and used away 
from the table top. This gyro-mouse 235 can be attached to the 
mini-book configuration 200 of FIG. 2A which consists of a right- 
hand browsing device 100 and a left-hand browsing device 101, and 
the whole assembly — the gyro-mouse configuration 230 — can be 
used in the hand away from the table top. Because in the mini- 
book configuration 200, both hands are used and the bottom 
buttons 131 - 134 and 181 - 184 are operated by all the fingers 
except the thumbs, the gyro-mouse 230 must be attached to the 
mini-book configuration 200 in such a way that the index fingers 
can also be used to operate the gyro-mouse buttons 236 and 237, 
as shown in FIG. 2E. The gyro-mouse buttons 236 and 237 must be 
near enough to the buttons 131 and 181 operated by the index 
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fingers so that the index fingers can reach them (buttons 236 and 
237) easily, while preferably a specially made gyro-mouse 235 
will be constructed to join with the mini-book configuration 20o' 
as shown in FIG. 2B, the mini-book 200, screen 210, and mouse 220 
configurations of the browsing devices lOO and lOl preferably add 
modular ly to existing computer hardware. 

FIG. 2P depicts the one-hand configuration 240 of the 
browsing device. in this configuration, only one browsing 
device loo is used, freeing one hand to do something else. 
During operation, the device lOO is held in one hand in much the 
same way as that in the mini-book configuration 200 - the thumb 
is placed on the sensor area 121 while the other fingers operate 
the buttons 131 - 134 on the bottom surface 130. The operation 
is largely the same as that for t^e mini-book configuration 200 
except now the browsing device 100 functions as the left device 
XOl as well as the right device 100 in the mini-book 
configuration 200. A triple click of the button 131 (refer to 
PIG. IB - the button nearest the index finger) toggles between 
these two states. This configuration 240 may not handle as well 
as the mini-book configuration 200 but it frees one hand for 
other operations. (Instead of triple-clicking an existing buttom 
such as button 131, an alternative is to add another buttom to 
the existing buttons and allow a single click of that button to 
effect the same operation.) 

FIG. 2G depicts the one-hand-gyro-mouse configuration 250 
of the browsing device. In this configuration, a gyro-mouse 255 
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is attached to one browsing device 100* The operation is largely 
the same as in the one-hand configuration 240 in FIG. 2F except 
now the one index finger also operates the mouse buttons 256 and 
257. Again, like in the case of the gyro-motise configuration 230 
depicted in FIG. 2B, in this configuration the buttons 256 and 
257 of the gyro-mouse 255 must be positioned near the button 131 
on the bottom surface 130 of the browsing device 100 that is 
nearest the index finger during normal operations of the device 
100 so that the index finger can operate all three buttons 256, 
257 and 131 easily* If no such gyro-mouse 255 exists, then a 
specially made one has to be used. 

The browsing device 100 employed in the configurations 200, 
210, 220, 230, 240, and 250, among others, can be used in 
conjunction with a number of different methods for displaying the 
movement through the document involved on the computer screen in 
a computer book. Among others, there are five methods which will 
be described here. 

FIG. 5A depicts one preferred embodiment of the flipping 
method 500. In this method, the material in the document is 
organized into pages and as one moves through the document, the 
pages are shown to flip across from right to left or vice versa, 
depending on the direction of movement, much like what happens 
when one flips through a physical book. In this method, when a 
permanent-bookmark is being transferred from one side to the 
other, it will be shown to be attached to the page, sticking out 
from the page, and flipped together with the page. Also, to be 



r 

wo 98/09446 



PCT/S€;97/00036 



38 



consonant with the flipping of successive pages, in the process 
of jumping to a different page in the document, the pages skipped 
are shovm to flip across together as a thick page (the thickness 
being proportional to the number of pages involved) like in the 
case of a physical book. The display of the thicknesses of the 
material in the document on both sides of the displayed pages, 
the use and display of bookmarks (finger-bookmarks or permanent- 
bookmarks) , the operations of bookmarking, and the display of the 
location, on the thicknesses, of the page/point in the document 
that would be jumped to were jumping to be effected at any given 
moment based on, say, the thumb's x-position on the sensor area 
121 at that moment are like what is described above for the 
computer book 300 in FIG. 3. 

Osing commercially available computer hardware and software, 
one method of generating flipping pages from a document stored 
in semiconductor, magnetic, optical, or other media on a personal 
(e.g. laptop) computer in the form of a text file, such as a text 
file in the Windows 95 operating system involves several steps. 
First, the contents of the text file is displayed on the computer 
screen (such as an IBM Color Monitor G50, part Number 96G1593) 
using, say a word processing software such as Microsoft® Word 
Version 7.0 from Microsoft Corporation, Part Humber 62306 running 
on the computer. The image on the computer screen which is 
stored in the screen dump can then be put into the clipboard 
using the "Print Screen" key on the keyboard (such as an IBM 
Keyboard, Part Number 06H9742). The clipboard can be imported 
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as an image file into a graphics software such as Visioneer 
PaperPort from Visioneer Communications, Inc. of Palo Alto, 
California, Part Number C1132-90000 running on the computer using 
the "Paste" command provided by the software, and then exported 
and stored as an image file in, say, the TIFF format. Each page 
in the document can be captured in this way in one TIFF file. 
Then, using a video editing/movie making software such as Adobe 
Premier ^4.0 from Adobe Systems Incorporated of Mountain View, 
California, part Number 02970103 running on the computer, the 
TIFF files, each containing one page of the document, cem be 
imported into the software and using the Motion command aind 
superimposition facilities provided by the software a "movie" of 
flipping pages can be generated and if necessary, exported and 
stored in a motion picture format such as a .AVI file* 

For the purpose of the present invention, the various 
components /operations described above for generating flipping 
pages from an existing document file using currently availaible 
software are preferably integrated into a single software process 
that may be conveniently ported from one computer to the next and 
which requires minimal human intervention. An alternative method 
reads from the existing document file directly, generates the 
necessary images for all the pages, and then creates a "motion 
picture" of flipping pages from these images. To move through 
the document forward or backward at any selected speed, 
mechanisms similar to forwarding or reversing at any selected 
speed when viewing a motion picture file (such as one in the .AVI 
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format) using a software video player (such as Video for Windows 
from Microsoft Corporation) are used. The other features such 
as the thicknesses 310 (fig. 3), the bookmarks 32o (FIG. 3) and 
the operations of bookmarking etc. are also incorporated. 

While it is preferred to use off-the-shelf hardware and 
software to effect the flipping/ flashing/ scrolling/etc. effect, 
customized hardware and software can be used to perform an 
equivalent function. 

FIG. depicts one embodiment of a open fan display «00 and 
FIG. 6B depicts one embodiment of a collapsed fan display 610 
that can be created in conjunction with the flipping method 500. 
In the process of effecting the flipping of the pages using one 
thumb (say, the right thumb 122, which operates the sensor area 
121 in the configuration 200, say) , one can stop the pages from 
being completely flipped to the other side by the use of the 
other thumb (say, the left thumb 172) by applying a force on its 
associated sensor area (171 in the configuration 200, say) after 
the page has begun flipping. This force will be referred to as 
the opposing force. The force applied by the other thumb (in this 
case, the right thumb 122) will be referred to as the flipping 
force. 

There are two kinds bf fan display that can be created - the 
open fan display 600 or the collapsed fan display 610 - depending 
on the magnitude of the opposing force. If the opposing force 
is of a magnitude roughly the same as or smaller than the 
flipping force, the pages 603 that have been flipped since the 
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beginning of the process (i.e., since the opposing force has been 
applied) form equal angles between themselves as well as the two 
"flat" pages 601 and 602 on the left and right sides of the book 
as depicted in FIG. 6A. This creates the open fan display 600. 
If the opposing force is greater than the other force , a 
collapsed fan display 6X0 is created as shown in FIG. 6B. In 
this display 610, all the pages 605 that have been flipped since 
the beginning of the process (i«e., since the opposing force has 
been applied) are collected in a thick page 604 that forms an 
equal angle with the two "flat" pages 606 and 607 on the left and 
right sides of the book as depicted in FIG. 6B. 

The open fan display 600 or the collapsed fan display 610 
can also be created in conjxinction with the process of jumping 
to another page. Earlier it was described that in order to be 
consonant with the flipping of successive pages, in the process 
of jumping to a different page in the document, the pages skipped 
are shown to flip across together as a thick page (the thickness 
being proportional to the number of pages involved) like in the 
case of a physical book. This thick, flipping page will be 
treated like any of those flipping pages 603 in the process of 
creating the open fan display 600 or the flipping pages 605 in 
the process of creating the collapsed fan display 610. Hence 
after a justing process has been initiated and after the skipped 
pages have begun flipping across together as a thick page, if one 
were to now apply an opposing force, the process of creating a 
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open fan display 600 or a collapsed fan display 610 will begin 
as described above. 

If the thumb that initiated the flipping now stops applying 
force - i.e., the flipping force - to the sensor area (121 or 171 
in the configuration 200, say), the pages will freeze in the open 
fan display 600 or the collapsed fan display 610, depending on 
which type of display is being created. For the collapsed fan 
display 610, at the nonent when the flipping force stops, there 
could be one page 60S that is still in the process of being 
flipped as depicted in FIG. 6B. This page will iamediately 
collapse onto the center, thick page 604 that has collected in 
it all those pages flipped earlier. 

The open fan display 600 facilitates the viewing of many 
pages simultaneously, even though only the rough contents of each 
page can be properly viewed. The collapsed fan display 610 
facilitates the viewing and comparison of the two flat pages 606 
and 607 that are currently in view since all the flipped pages 
605 have been collected in the center, thick page 604 that does 
not block the view of the two flat pages 606 and 607. 

If now the thumb that applied the opposing force - the thumb 
that prevented the complete flipping of the pages - removes its 
force, and then that is followed by the normal initiation of the 
flipping action by either thumb, the fanned out pages 603 (in the 
case of the open fan display 600) or the center thick page 604 
(in the case of the collapsed fan display 610) will collapse and 
flip over to the appropriate side and normal flipping begins. 
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FIG. SB depicts one embodiment of the sliding method 510. 
In this method 510, the material in the docviment is organized 
into pages and the pages are shown to slide across the screen, 
much like what happens when one views a microfilm. However, 
unlike the case of the conventional microfilm viewer, more than 
one page can be displayed here, depending on the choice of the 
user. In this method 510, when moving through the document, the 
pages are seen to move horizontally within a fixed frame - as a 
page slides leftward, as it appears on the right side of the 
frame, its left side appears first and as it reaches the left 
side of the firame, the left side of the page would disappear 
first and vice versa for rightward movement. FIG. SB shows two 
pages being displayed at the same time but in this method 510 any 
number of pages can be displayed at the same time, depending on 
the user's preference and the selection made. 

In the sliding method 510, v*en a permanent-bookmark is 
being transferred from one side to the other, it will be shown 
to disappear from the side from which it originates and appear 
on the other side when the page involved reaches the other side. 
To be consonant with the sliding of successive pages, in the 
process of jumping to some other parts of the document, the 
page(s) jumped to is shown to slide into view much like what 
happens when one operates a physical microfilm. The display of 
the thicknesses of the material in the document on both sides of 
the displayed pages, the use and display of bookmarks (finger- 
bookmarks or permanent-bookmarks) , the operations of bookmarking. 
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and the display of the location, on the thicknesses/ of the 
page/point in the document that would be jumped to were jumping 
to be effected at any given moment based on, say, the thumb's x- 
position on the sensor area 121 at that moment are like what is 
described above for the computer book 300 in FIG. 3. 

To generate sliding pages, a method similar to that 
described for the flipping pages for PIG. 5A can be used. 

FIG. 5C depicts the flashing method 520, where the material 
in the document is organized into pages and one or more than one 
page at a time (as specified by the user) is flashed onto the 
screen as one moves through the document - that is, the current 
page (s) , disappears and the next page(s) before or after the 
current page(s) appears. FIG. 5C depicts, in particular, the 
case in which two pages are displayed at. a time. When more than 
one page is displayed on the screen and flashing is effected, it 
can be effected in two modes - the oxclusive mode or the 
overlapping mode. Consider the case of displaying two pages at 
one time on the screen as shown in FIG. SC. In the exclusive 
mode, the next two pages that appear are the two pages that 
follow the righthand page of the previously displayed pages. In 
the overlapping mode, the next two pages that appear are the 
righthand page from the previously displayed pages and the page 
that follows that page. Similarly, when more than two pages are 
displayed at any given time, the exclusive mode dictates that the 
next pages displayed will not be the same as the currently 
displayed pages and the overlapping mode dictates that the next 
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pages displayed can have some but not all of the pages that are 
the same as the currently displayed pages. Hence the overlap 
refers to the same pages that are displayed in the current 
display as well as the very next display of the pages. For more 
than two pages , the user can specify the amount of overlap for 
the overlapping mode. 

In the flashing method 520, when a permanent bookmark is 
being transferred from one side to the other, it will be shown 
to disappear from the side from which it originates and appear 
on the other side when the page involved reaches the other side. 
The display of the thicknesses of the material in the document 
on both sides of the displayed pages, the use and display of 
bookmarks (finger bookmarks or permsment bookmarks) , the 
operations of bookmarking, and the display of the location, on 
the thicknesses, of the page/point in the document that would be 
jumped to were jumping to be effected at any given moment based 
on, say, the thumb's x-position on the sensor area 121 at that 
moment are like what is described above for the computer book 300 
in FIG, 3. 

To generate sliding pages, a method similar to that 
described for the flipping pages for FIG. 5A can be used. 

FIG. 5D depicts the scrolling method 530. Even though 
scrolling usually results in a blur, this method can still 
benefit from the ease of control using the browsing device 100. 
In this method 530, the material in the document is not organized 
into distinct pages. Instead , lines of text or portions of 
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graphics disappear from the top of the display and appear at the 
bottom of the display or vice versa as the document is moved 
through forward or baclcward respectively. The thicknesses 531 
of material present before or after the currently viewed material 
are shown on the top and bottom of the display as shown in FIG. 
5D. The bookmarks 532 (finger-bookmarks or permanent bookmarks) 
can likewise be displayed on these thicknesses 531. The 
operations of bookmeurking and the display of the location, on the 
thicknesses 531, of the page/point in the document that would be 
jumped to were jumping to be effected at any given moment based 
on the thumb's x-position on the sensor area 121 at that moment 
are like what is described above for the computer book 300 in 
FIG. 3. 

To generate scrolling pages, a method similar to what is 
used in Microsoft® Word Version 7.0, Part Nximber 62306 can be 
used, with appropriate enhancements for the display of the 
thicknesses 310 (FIG. 3), the bookmarks 320 (FIG. 3) and the 
operations of bookmarking, etc. 

If the mini-book configuration 200, say, is used in 
conjunction with the scrolling method 530 of moving through the 
document, the user can rotate the mini-book configuration 200 
held in his/her hand which is normally used "horizontally" - with 
the left-hand device 101 held to the left and the right-hand 
device 100 held to the right (FIG. 2A) - by, say, 90 degrees 
clockwise, so that the left-handed device 101 is now on the top 
and the right-handed device 100 is now on the bottom (to achieve 
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this, the left and right wrists will have to bend a fair bit). 
The controls will now be more natural because they correspond 
better to what is seen on the screen - i.e., the left-hand/ top 
device 101 and the right-hand/bottom device ICQ will now operate 
the bookmarks on the top and bottom respectively of the material 
shown on the screen in the scrolling method 530. 

In the scrolling method 530, depending on the user's 
preference, a scroll bar 533 and a marker 534 on it, similar to 
what is normally used in a word processor, can be added to one 
side, say the right side, of the displayed material, as shown in 
FIG. 5D, to indicate the position of the currently viewed 
material in the document involved, but the mEurker 534 here is not 
used in conjunction with the browsing device XOO for effecting 
the scrolling of the document. (In current word processors, 
normally the meurker 534 is used in conjunction with the moose for 
effecting the scrolling of the document.) Alternatively, 
bookmarks 535 are added to the scroll bar 533 to indicate the 
pages bookmarked. However, the display of the bookmarks 532 on 
the top and bottom of the currently viewed material is still 
necessary because their positions along the top and bottom edges 
give an indication of the fingers and buttons on the browsing 
devices 100 and/or 101 (depending on whether one or two devices 
are being used) that are to be used to jump to the pages that 
they mark. In this method 530, when a bookmark is inserted, it 
is associated with the material that is cxirrently in view. For 
permanent-bookmarks, they disappear from one side (top or bottom) 
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of the display and appear on the other side (bottom or top 
respectively) when the associated material has gone completely 
out of view. 

In the flashing method 520 and scrolling method 530, in the 
process of jumping to some other parts of the document, the 
page(s) or parts of the docixment jumped to are flashed onto the 
screen, much like what happens when one uses the scroll bar in 
conjunction with the mouse to jump to some other parts of the 
document in a typical word processor. 

FIG. 5E depicts the vertical flipping method 540 of the 
browsing device. This method is similar to the flipping method 
500 depicted in FIG. 5A, and except for the flipping action that 
is effected vertically instead of horizontally, all other 
operations are the same as that described for the flipping method 
500, including the vertical equivalents of the open and collapsed 
fan displays depicted in FIGS. 6A and 6B. Similar to the case 
described above for the scrolling method 530, if the mini-book 
configuration 200, say, is used in conjxinction with the vertical 
flipping method 540 of moving through the document, the user can 
rotate the mini-book configuration 200 held in his/her hand which 
is normally used "horizontally* - with the left-hand device XOl 
held to the left and the right-hand device 100 held to the right 
(FIG. 2A) - by, say, 90 degrees clockwise, so that the left- 
handed device 101 is now on the top and the right-handed device 
100 is now on the bottom (to achieve this, the left and right 
wrists will have to bend a fair bit) . The controls will now be 
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more natural because they correspond better to what is seen on 
the screen - i-e,, the left-hand/top device 101 and the right- 
hand/bottom device 100 will now operate the bookmarks on the top 
and bottom respectively of the material shown on the screen in 
the vertical flipping method 540. 

The simultaneous multiple indexing facility is now 
described. In the process of viewing a document, if there is a 
keyword or phrase that is of interest to the user, one can select 
it using one of the usual methods - the mouse cum cursor method, 
the finger cum pressure-sensing computer display screen method, 
etc. - and then all those pages that contain the explanations or 
related topics of the selected item will become permanently- 
bookmarked - i.e., all the corresponding bookmarks 320 will 
appear on the displayed computer book 300 like that described 
above (FIG. 3). On the bookmarks 320, markings, letters or 
otherwise, will appear to indicate the kind of information these 
pages contain about the selected item (e.g., basic definition, 
detailed elaboration, related concepts, etc.). The name of the 
selected item will also appear on the corresponding bookmark 320 
(in case more than one item has been selected). The user can 
then quickly jump to these pages. This facility allows the user 
to bypass the need of having to move through the document first 
to an index (usually at the end of the document) to locate the 
various references to the item of interest and then jump to those 
corresponding pages. Many returns to the index would also have 
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to be carried out if there is more than one reference to the item 
involved. 

FIG. 7 depicts an embodiment of a complete browsing system 
700. in this system 700, a conversion software 7lo (a computer 
program preferably coded in a "C programming language") is 
provided to pre-convert the document 701 to be viewed that is 
stored in the computer in whatever existing form (e.g., such as 
in the form of a text file, stored on the hard disk in the 
Windows 95 operating environment) to a form 7ii that allows one 
of the five methods (500, 510, 520, 530 and 540) of moving 
through the document as described above or other methods to be 
implemented and to be used in conjunction with the browsing 
device 740 (in one of the configurations 200, 210, 220, 230, 240, 
and 250 described above or other configurations) . The document 
701 in its existing form on the computer can also be converted 
on the fly which may require specialized hardware to achieve the 
required speed of operation. During operation, a browsing/viewing 
software 720 is also needed to convert the signals from the 
browsing device to effect all the operations on the document as 
described above. The browsing/viewing software 720 (a computer 
program preferably coded in a "C programming language") takes as 
its data input either the pre-converted data file 711 or the 
document in its existing form 701 (to be converted on the fly 
during the browsing process) . The browsing device 740 sends the 
necessary signals through a bus 741 (preferably a 25 pin parallel 
port ribbon cable, although a serial bus or mouse line are 
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example alternatives which require appropriate cooperating 
multiplexing circuitry) and to a computer input port 730 
(preferably a 25 pin parallel port, or alteratively a mouse port 
or a RS-232 port) to the browsing/viewing software 720 to effect 
the necessary operations on the screen 721 of the computer. 

FIG. 8 depicts one embodiment of the browsing device's 100 
electrical block diagram 800. The sensor area 121 on the 
browsing device 100 (FIG. IB) is made up of a force and position 
sensor that is used to sense the force and position of the thumb 
122 (or one of the other fingers) on that area, and signals 
representing these two parameters are made available through a 
Force and Position Signals Generator Circuit 801 (preferably the 
separated Force and Position Analog LP Interface circuit 
described in the Interlink Electronics, Inc. docxment "FSR® 
Integration Guide and Evaluation Part Catalog with Suggested 
Electrical Interfaces"). Respective Force and Position signals 
are presented to the computer through one of the input ports 730 
(FIG. 7) , to the software 720 responsible to effect the necessary 
operations on the screen of the computer. The signals from the 
buttons 111 114 and 131 - 134 (of which are preferably on/off 
push-button toggle switches) on the top surface 110 and bottom 
surface 130 respectively of the browsing device 100 (FIG. IB) are 
also transmitted to the computer via the bus 741. A common 
voltage line is available to send a corresponding common voltage 
through individual ones of the buttons 111 - 114 and 131-134 
when the respective buttons are closed. 
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FIGS. 9A, 9B and 9C depicts another embodiment 900 of the 
browsing device xoo of FIG. IB. This device 900 includes many 
thin, hard and flexible pieces of material 901 bound together in 
the manner of the binding of the pages in a book, except that the 
"flipping* side is made into a slanted surface 920 in much the 
same way as in the device XOO depicted in FIG. IB. When the thumb 
X22 applies a force onto the slanted surface 920, the "pages* 901 
will bend like the pages in a normal book and the bending force 
is sensed to effect the same operations as those performed by the 
thumb's force on the slanted surface 121 of the browsing device 
100. To jump to a certain page, the thumb 122 slides along the 
slanted surface 920 in the x-direction (similar to that defined 
for the browsing device lOO) until it reaches the desired 
position, say XT, and then it bends the remaining pages 901, muc^ 
like one would bend the pages of a book in the process of holding 
onto the left and right edges of the book to browse through the 
pages, which results in a slight separation 960 of the pages 901 
for ^ich X > XT from those pages for which x < XT and a gap 960 
in the pages 901 is created where the thumb 122 is placed. Thin 
film sensors 970 are placed on the surfaces of these mini-pages 
901 to sense the separation 960 and hence the location to jump 
to in the document involved. The mapping of the position of the 
thumb 122 to the page jumped to in the document is identical to 
that used in the device 100 depicted in FIG. IB as described 
above in the flowcharts in FIGS. 4A and 4B. Four buttons 911 - 
914 are provided on the top surface 910 and four buttons 931 - 
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934 are provided on the bottom surface 930 of the device 900 that 
function like the four buttons 111 - 114 on the top surface lio 
and the four buttons 131 - 134 on the bottom surface 130 
respectively of the browsing device 100. Mechanisms 951 and 952 
are also provided to join two devices 900 (a left-hand and a 
right-hand version) together. All other operations are identical 
to those described for the device 100 depicted in FIG. IB. 

FIGS. 10a and lOB depict yet another embodiment looo of the 
browsing device 100 of FIG. IB. In this embodiment 1000, an LCD, 
plasma or other type of display screen 1005, much like what is 
normally used as a computer monitor, is fitted onto the slanted 
surface 1002 of the browsing device 1000 as shown in the upper 
and lower views of FIGS. lOA and lOB. It is used to display the 
amount of material present before and after the currently viewed 
material. To do this, a thickness 1007 is displayed on the 
screen 1005 that is proportional to the amount involved, that 
changes with the changes of the amount involved. On this 
thickness 1007, bookmarks 1020 can be displayed that indicate the 
locations of the pages/parts of the document involved. The same 
methods as described before for the computer book 300 depicted 
in FIG. 3 are used here on the screen 1005 for the following: (a) 
display the change of thickness; (b) display the bookmarks, and 
(c) display, the thickness 1007, of the location of the 
page/point in the document that would be jumped to were jumping 
to be effected at any given moment based on the thumb's x- 
position on the sensor area 1006 at that moment- Transparent 
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force and position sensors 1006 overlay the screen 1005 and 
function much like what has been described before for the sensor 
area 121 in the browsing device 100 except that now the thumb 122 
can move to the "absolute" location of the page to be jumped to 
effect the jumping, m this scheme, even though the thickness 
1007 of material as well as the bookmarks 1020 are displayed on 
the screen 1005 of the browsing device 1000, they can also be 
displayed on the computer monitor screen like in the case 
described for the computer book 300 in FIG. 3 at the same time. 

The absolute distance method for computing the point/page 
in the document to jump to when jumping is activated will be 
described. Let x = 0 be the x-position on the screen 1005 that 
is nearest the edge adjoining the top surface 1010 and the 
slanted surface 1002. Recall that the intersection of the thumb 
122 with the slanted surface 1002 has some spatial extent and the 
thumb 122 is considered to be at position xi if it covers the 
point Xi and some contiguous points x such that x > xl. Consider 
now that the thickness of the book displayed on the screen 1005 
is xs - XH, where xs is the width of the screen 1005. Let PR be 
the amount of remaining material in the document as defined 
before. The process of jumping can only be activated when the 
thumb 122 is at XT > XH, and when that happens, the amount of 
material skipped, pj, is equal to PR * (XT - XH) /XS. 

In the embodiment of the browsing device 1000, four buttons 
1011 - 1014 are provided on the top surface lOlO and four buttons 
1031 - 1034 are provided on the bottom surface 1030 of the device 
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1000 that function like the fours buttons ill - 114 on the top 
surface 110 and the fo\ir buttons 131 - 134 on the bottom surface 
130 respectively of the browsing device 100. Mechanisms lOSl and 
1052 are also provided to join two devices 1000 (a left-hand and 
a right-hand version) together. All other operations are 
identical to those described for the device lOO depicted in FIG. 
IB. 

The above browsing system 700 (FIG. 7) is adapted to be used 
in conjunction with any software method that allows the 
reorganization of the material in the document involved to 
facilitate browsing/ viewing. For example, under software 
control, in conjunction with the use of a mouse cum cursor 
method, say, two or more pages in the document to be compared or 
parts of the document to be conqpared can all be brought together 
and displayed in the ctirrently viewed page(s). This may be 
achieved by, say, using the mouse cum cursor to first select 
parts of the current viewed pages by clicking the mouse button 
and dragging the mouse like what is normally done or to select 
one of the currently viewed pages by do\ible clicking on that page 
where the cursor is now positioned. And then, after moving to 
another part of the document, the cursor can now be positioned 
over a point on one of the currently viewed pages and the 
selected material can be brought into view by one click of the 
mouse button. The selected material, if it is one page full, 
will simply cover the page on which the cursor was placed before 
the one click of the mouse button to bring it into view. If the 
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selected material is not one page full, it will be positioned, 
say, to the right and bottom of the cursor, and cover part of the 
page on which the cursor was placed before the one click of the 
mouse button to bring it into view. Another click of the mouse 
button will remove this temporarily placed material to allow one 
to see What was on the page originally. This temporarily placed 
material will also automatically disappear from the page on which 
it was placed after that page disappears from view after the user 
activates movement to other parts of the document. 

The above browsing system 700 can also be used in 
conjunction with any software method that allows the highlighting 
of selected portions of the material or annotations of the pages 
in the document involved to facilitate browsing/ viewing/reading. 

The above browsing system 700 is suitable for use not just 
for browsing through or viewing documents that do not require any 
processing of their contents while they are being viewed, but 
also in conjunction with a word-processing system, instead of 
creating a document and processing it on a computer screen like 
what is nonnally done, and then scroll up and down to view and 
browse through it using the usual mouse cum scroll bar method, 
the method of viewing and browsing through the document as 
described in the above browsing system 700 can be used. The 
process of entering/deleting material in the document can also 
be made to be consonant with the method of movement through the 
document (i.e., one of the methods 500, sio, 520, 530 and 540 
described in FIGS. 5A - SE) . If the word processing is used in 
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conjunction with, say, the flipping method 500 of moving through 
the document, as one finishes entering material for the right- 
hand page, the page will flip over to reveal a new, empty page 
for the entering of material. As one deletes material until 
nothing is left on the currently viewed pages, continued deletion 
will effect a flipping back to the previous page. Similar 
mechemisms can be used in conjunction with the other three non- 
scrolling methods of moving through the document - namely the 
sliding method 510, the flashing method 520, and the vertical 
flipping method 540. 

The above browsing system 700 is adapted for use in 
conjxinction with any software in which there is infoinnation/ icons 
of control "buttons" to be displayed, either for viewing or 
manipiaating, that cannot be fitted within one computer screen. 
In this case, scrolling in conjunction with the use of a mouse 
is often done, or sub-menus and sub-operations can be selected 
by pressing icons of "buttons" on the screen. In the case of 
selection of sub-menus and sub-operations, the sub-menus or 
displays containing buttons for sub-operations are flashed on the 
screen once they are selected. When there is a large amount of 
this kind of information/ operations present in the software, it 
will benefit from the use of the browsing system - the system can 
provide a good idea of what kinds of information/ operations are 
available, where they can be found and how they are related to 
each other, as well as fast access to them. To be used in 
conjunction with the current browsing system 700, these 
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menus/sub-»enus and buttons for operations/ sub-operations can all 
be organized into a "book" and access to the« can be effected by 
the browsing system 700 described above. 

currently, the most popular and convenient form of human- 
coaputer interface is the "windows- interface. This interface 
grows out of the "desktop metaphor' in which manipulating items 
on a computer screen is likened to manipulating items on a 
desktop. This kind of interface, though it is a vast improvement 
over previous kinds of interface and is very friendly to use, 
still suffers from one of the problems of manipulating items on 
a desktop - a person's desktop tends to get very messy and things 
are hard to find when there are too many of them present. In the 
windows interface, when there are a lot of sub-directories/ files 
within a directory that camiot be fitted within one window or one 
screen, they are to be located by scrolling through the use of 
a mouse, with all the attendant problems as described above for 
the browsing of information using this method. Also, when many 
windows are opened, they tend to obscure each other and those 
that are currently not in view are hard to find because their 
locations (in the "third dimension" - the "direction perpendicular 
to the screen") are not fixed, much like a scattered collection 
of papers on a desktop. 

The human-computer interface can be improved by organizing 
these directories/sub-directories or temporary working windows 
into -books" to be manipulated by the browsing system 700 
described above. All information on the computer can be 
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organized into one big booX or more than one book at any given 
moment, hence the "library metaphor". There are at least three 
possible improvements: (a) sub-directory and file icons that 
cannot be fitted onto one window/ screen can be browsed through 
and better accessed if they are organized/ implemented in a form 
to be used in conjunction with the browsing device/system 700 
described above FIG. IIA depicts one embodiment of this in 
conjunction with the flipping method 500 of moving through the 
document: items 1101 - directories/sub-directories or files- in 
a window 1105 are placed in the pages of the book 1100 which is 
an instance of the computer book 500 depicted in FIG. 5A; (b) 
sub-directories lll5 (FIG. IIB) and files 1116 that are normally 
found in windows 1114 in the current window-based systems can be 
organized into chapters, sections, etc. in a computer book 1120 
(an instance of the computer book 500 depicted in FIG. 5A) 
instead and iised in conjunction with the browsing system 700, an 
embodiment of which is depicted in FIG. IIB; and (c) items that 
are being worked on, either collections of files and sub- 
directories or the current working areas in a software (such as 
a word-processor) which current systems present in "windows", can 
be organized into pages in a "scrap book" to be used in 
conjunction with the browsing system 700 with its attendant 
advantages. FIG. llC depicts one emi)odiment of this in 
conjunction with the flipping method 500 of moving through the 
document. Either each window 1125 maps onto one page or many 
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windows 1125 can map onto one page in a computer book 1130 (an 
instance of the computer book 500 depicted in FIG. 5A) . 

FIG. 12 describes a method for displaying a computer-based 
set Of information on a display screen controlled by the 
inventive browsing device, step l displays a thickness image of 
a set of information corresponding to the size of a data file 
Which holds the set of information. The thickness image includes 
a left side portion and a right side portion which are displayed 
on the display screen. The left side portion of the thickness 
image is displayed on the left side of the screen and is 
proportional to an amount of the information that proceeds a 
given point in the set of information that is currently being 
displayed on the display screen. The right-hand portion of the 
thickness image is displayed on the right-hand side of the 
display and is proportional to an amount of the information that 
comes after the point as currently displayed on the display 
screen. For example, if the currently displayed point is near 
the end of the document, the left-hand side of the display will 
have a thickness image that appears thicker than that on the. 
right-hand side. 

After step l, the process flows to step 82 where all 
existing finger-bookmarks are displayed in a first image format. 
Then, in step 83, all existing permanent-bookmarks, are displayed 
in a second format. Both the finger-bookmarks and the permanent- 
bookmarks are displayed in the location in the thickness display 
corresponding to the locations of the material they bookmark. 
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Then the process flows to step 84 where the user elects to 
bookmark the currently viewed material and a new bookmark 
(f inger-bookmetrk or permanent bookmeurk) is added to the display. 
After 84, the process flows to step 85 where a position within 
the set of information is jumped to in response to a jump 
position indicated by the instrument (e.g., the user's finger). 
Once the position is jumped to, the process ends. 

FIG. 13 describes a method for browsing a computer-based set 
of information. The process starts in step 811 where a move 
command is generated to move a pointer through a set of 
information hosted on the computer either in a forward direction 
or a backward direction. The process then flows to step 812 
where the pointer is moved in response to the command that was 
generated in step 811. The process then flows to step 813 where 
the speed of movement of the pointer through the information is 
adjusted. The process then flows to step 814 where a jump 
command is received. The process then flows to step 815 where 
a pointer is moved to a jump position in response to the received 
jump command. The process then moves to step 816 where a 
bookmark coiomand is received to mark a desired portion of text 
or graphics information from the set of information. A user 
enters the bookmark command based on the desired portion of 
tesctual graphics. The process then moves to step 617 where the 
desired portion is marked in the set of information corresponding 
to the received bookmark command, afterwhich the process ends. 
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FIG. 14 is flowchart for a cooputer-interface process. The 
process starts in step 820 where a set of information hosted on 
the computer is arranged in a set of booXs. Each of the books 
includes a subset of the information from the set of information 
hosted on the computer, once arranged, the process flows to step 
.821 Where each of the booJcs is labelled with a respective portion 
Of the subset of information corresponding with each book. The 
process then flows to step 822 where, based on user input, a user 
can select a selected book by first viewing books which are 
displayed as a single book document image. The book document 
image is made up of individual pages that correspond to the 
respective portions of the books. The process then flows to step 

823 Where a command is generated, as actuated by the user, to 
move through the pages so that a user can view the individual 
pages and select a desired book. The process then flows to step 

824 Where the pages of the book are displayed in an animated 
image where the pages of the book document are either flipped 
(preferable), scrolled, slid or flashed on the screen. The 
process then flows to step 825 where, while viewing the animated 
image, the user via user input can select one of the pages. By 
selecting one of the pages, the user has selected the desired 
book. The process then flows to step S26 where the selected book 
is displayed as the image of a book document. However, pages of 
the selected book document include respective portions of the 
subset Of information corresponding to the selected book. The 
process then flows to step 827 where a move coranand is generated 
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for moving a pointer through a subset of the pages of the 
selected book. The process then flows to step 828 where an 
animated image is displayed of the pages in the selected book 
being shown as either flipped (preferable) , scrolled, slid or 
flashed on the screen. The process then flows to step 829 where 
a selected book page of the selected book is selected by the user 
via a user input indication. Once the user has selected the 
desired book page, the process ends. 

While particular embodiments of the present invention have 
been illustrated and described, it will be appreciated that 
numerous changes and modifications will occur to those skilled 
in the art, and it is intended that the appended claims cover all 
those changes and modifications which fall within the spirit and 
scope of the present invention. 

Obviously numerous modifications and variations of the 
present invention are possible in light of the above teachings. 
It is therefore to be understood that within the scope of the 
appended claims, the invention may be practiced otherwise than 
specifically described herein. 
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CIATMff ; 

1. A computer-based information browsing device 
comprising: 

a body having a sensor device disposed on a sensor area 
of said body that detects a position and a force of an 
instrument applied to said sensor device; 

at least one set of sensors actuable by said instrument, 
disposed on said body, and configured to produce at least one 
state signal when at least one of said set of sensors is 
actuated by said instrument; 

a transducer circuit connected to said sensor device 
which converts the force and position detected by said sensor 
device into at least one transducer signal; and 

an output port which outputs the at least one transducer 
signal and said at least one state signal to a computer which 
hosts a set of information, said at least one transducer 
signal and said at least one state signal forming at least one 
of a direction of movement command, a change of speed command, 
a jump to a specified location command, and a bookmark command 
used by said computer to manipulate a displayed image of said 
set of information. 

2. The device of Claim i, wherein: 
said body comprises, 

an opposed top and bottom sxirface, and 
a sensor surface in which said sensor device is 
disposed; and 



wo 98/0^6 



PCT/SG97/00036 



65 

said set of sensors comprises, 

a first subset of sensors disposed on said bottom 
surface, and configured to produce a first state signal of 
said at least one state signal representative of a state of 
said first subset of sensors, and 

a second subset of sensors disposed on said top 
surface, and configured to produce a second state signal of 
said at least one state signal representative of a state of 
said second subset of sensors. 

3. The device of Claim 2 further comprising: 
the computer, which receives from said output port, said 
at least one transducer signal and said at least one state 
signal, said computer comprising, 

a receiving mechanism that receives said at least 
one transducer signal, said at least one transducer signal 
comprising a first force signal and a second force signal 
respectively generated by said sensor device in response to 
said instrument applied to a first position along one 
direction of said sensor device and later applied to a second 
position of said sensor device, 

a jumping mechanism that produces a jximp from a 
first point in said set of information corresponding to said 
first position to a second point in the set of information 
corresponding to the second position, and 
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a skipping mechanism that produces a skip of a 
subset of said set of information proportional to a distance 
between said first position and said second position. 
4. The device of Claim 2, further comprising: 
the computer, which receives from said output port, said 
at least one transducer signal and said at least one state 
signal, said computer comprising, 
a display, 

a receiving mechanism that receives at least one of 
said first state signal and said second state signal, 

a creating mechanism that creates a finger-bookmark 
based on said first and second state signals received by said 
receiving mechanism, 

a display mechanism that displays an image of said 
set of information and a finger-bookmark image, said display 
mechanism comprising 

a removing mechanism that removes said 
finger-bookmark image when a currently displayed subset of 
information of said set of information is closer to an end 
position of said set of information than a position of said 
finger-bookmark image. 

5. Th6 device of Claim 4, wherein said computer further 
comprises: 

a permanent-bookmark image display mechanism that 
displays a perxaanent-bookmark image in response to receiving 
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said at least one of said first state signal and said second 
state signal; and 

a transferring mechanism that transfers said permanent- 
bookmark image from a first side of said image of said set of 
information to a second side of said image of said set of 
information when the currently displayed subset of information 
is closer to said end position of said set of information than 
a position of said finger-bookmark image* 

6. The device of Claim 5, wherein said computer-further 
comprises : 

a simultaneous display mechanism that simultaneously 
displays said finger-bookmark image and said permanent- 
bookmark image. 

7. The device of Claim 5, wherein said computer further 
comprises: 

a page jumping mechanism that jumps to a page of said 
image of said set of information nearest the currently 
displayed material, said page being marked by at least one of 
said finger 'bookmark or said permanent-bookmark. 

8. The device of Claim 5, wherein said computer f\irther 
comprises: 

a page jumping mechanism that jumps to a page of said 
image of said set of information in response to receiving said 
at least one transducer signal and said at least one state 
signal. 

9. The device of Claim 2, further comprising: 
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a mouse having mouse buttons, 

wherein said body is disposed on said computer mouse so 
not to interfere with the mouse buttons. 

10. The device of Claim 2, further comprising: 
a gyro-mouse having gyro-mouse buttons, 

wherein said body is disposed on said gyro-mouse so not 
to interfere with the gyro-mouse buttons. 

11. A device according to Claim 2, further comprising: 
the computer, which receives from said output port, said 

at least one transducer signal and said at least one state 
signal, said coo^uter comprising, 

a receive mechanism that receives said first state 
signal comprising sequence change signal representative of a 
change of said state of said second subset of sensors, and 

a toggling mechanism that toggles said browsing 
device between a left-hand device operation and a right-hand 
device operation in response to receiving said sequence change 
signal by said receive mechanism. 

12. A device according to Claim 2, wherein: 

said receive mechanism receives said sequence change 
signal which comprises a triple-click signal representative of 
a changing of said state of said second subset of sensors at 
least three times in succession, and 

said toggling mechanism toggles said browsing device 
between a left-hand device operation and a right-hand device 
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operation in response to receiving said triple-click signal by 
said receive mechanism. 

13. The device of Claim 2, fxirther comprising: 

a computer which receives from said output port, said at 
least one transducer signal and said at least one state 
signal, said computer comprising, 

a memory which stores said set of information, and 

a display screen, 

an organizing mechanism that organizes the set of 
information into a plxirality of pages, and 

a display mechanism that displays an image of said 
pages on said display screen. 

14. The device of Claim 13, wherein the display 
mechanism, further comprises: 

a successive image display mechanism that successively 
displays images of said pages of said set of information being 
flipped at a speed corresponding to the force applied to the 
sensor device. 

15. The device of Claim 13, wherein the display 
mechzmism, further comprises: 

a successive image display mechanism that successively 
displays images of said pages of said set of information being 
flipped in a first direction if said device is configixred to 
operate in a left-hand mode of operation, and in a second 
direction if said device is configxired to operate in a right- 
hand mode of operation. 
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16. The device of Claim 15, further comprising a means 
for switching said device between the left-hand mode of 
operation and the right-hand mode of operation. 

17. The device of Claim 14, wherein said display 
mechanism further comprises: 

a flipped plurality of pages display mechanism that 
successively displays said plurality of pages being flipped 
from at least one of a right-to-left direction with respect to 
a horizontal position of said display and from a top-to-bottom 
direction. 

18. The device of Claim 14, wherein said display 
mechanism further comprises: 

a sliding plurality of pages display mechanism that 
displays successive images of said pages sliding across said 
screen. 

19. The device of Claim 14, wherein said display 
mechanism further comprises: 

a flashing plurality of pages display mechanism that 
displays successive images of said pages flashing onto said 
computer screen as the set of information is browsed. 

20. The device of Claim 19 further comprising: 

mode selection means for selecting between an exclusive 
mode of operation or an overlapping mode of operation; and 

a displaying next page mechanism that displays a next 
page after a right-most displayed page, in a currently 
displayed image, when in the exclusive mode, and displays at 
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least one of a currently viewed page and a set of next pages, 
when in the overlapping mode. 

21. The device of Claim 14, wherein said display 
mechanism further comprises: 

a scrolling plurality of pages display mechanism that 
displays successive images of said pages scrolled onto said 
computer screen as the set of information is browsed* 

22. The device of Claim 14, wherein said computer 
further comprises: 

a thickness display mechanism that displays an image of a 
thicknesses of said set of information on a top portion and on 
a bottom portion of said display; and 

a scroll display mechanism that displays said image of 
said pages as a sequentially scrolled image in an up or a down 
direction relative to a horizontal direction of said display. 

23. A computer-based browsing device comprising: 

a left-hEuid computer-based information browsing device 
module, comprising, 

a first body configured to be operated by a left 
hand of a user, comprising, 

an opposed first top surface and a first bottom 

surface , and 

a first sensor surface having a first sensor 
device disposed thereon, said first sensor device detecting a 
position and force of an instrument applied thereto; 
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a first set of sensors actuable by said instrument, 
disposed on said first bottom surface, and configured to 
produce a first state signal of at least one state signal 
representative of a state of said first set of sensors, 

a second set of sensors actuable by said instrxment, 
disposed on said first top surface, and configured to produce 
a second state signal of the at least one state signal 
representative of a state of said second set of sensors, 

a right-hand computer-based information browsing device 
module operatively joined to said left-hand computer-based 
information browsing device, comprising, 

a second body configured to be operated by a right 
hand of a user, comprising, 

an opposed second top surface and a second 
bottom surface, and 

a second sensor surface having a second sensor 
device disposed thereon, said second sensor device detecting a 
position and force of an instrument applied thereto; 

a third set of sensors actuable by said instnament, 
disposed on said second bottom surface, and configured to 
produce a third state signal of the at least one state signal 
representative of a state of said third set of sensors, 

a fourth set of sensors actuable by said instrtment, 
disposed on said second top surface, and configured to produce 
a fourth state signal of the at least one state signal 
representative of a state of said fourth set of sensors. 
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at least one transducer circuit connected to at least one 
of said £irst sensor device and said second sensor device 
which convert the force and position of the instrument into at 
least one transducer signal; and 

an output port which outputs the at least one transducer 
signal and the at least one state signal to a computer , said 
computer hosting a set of information. 

24. The device of Claim 22, wherein said transducer 
circuit comprises: 

a right-hand transducer circuit configured to convert the 
force and position of the second sensor device into a forward 
browsing signal used by said computer to browse the 
information in a forward direction; and 

a left-hand transducer circuit configured to convert the 
force and position of the first sensor device into a bac)cward 
browsing signal used by said computer to browse the 
information in a baclcward direction, wherein a speed of 
browsing in either the forward or the reverse direction is 
proportional to the force respectively applied to said second 
sensor device and said first sensor device. 
25. The device of Claim 24, wherein: 

said a right-hand transducer circuit being configured to 
produce a forward jump signal corresponding to the force 
applied at a position along a first direction of said second 
sensor device indicative of a forward point in the information 
in which to jvimp, said forward point in which to jump located 
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between a portion of said information currently being 
displayed, and an end of said information; and 

said left-hand transducer circuit being configured to 
produce a bac}cward jump signal corresponding to the force 
applied at a position along a first direction of said first 
sensor device indicative of a backward point in which to jump 
located between said portion of material currently being 
viewed and a beginning portion of said information. 

26. The device of Claim 23, wherein said output port 
comprises: 

a right-hand output port configured to output a set of 
right-hand bookmark signals corresponding to respective states 
of said third set of sensors, each of said set of right-hand 
bookmark signals corresponding to a command output to said 
computer to place a right-hand bookmark on said information 
cturrently being displayed; and 

a left-hand output port configured to output a set of 
left-hand bookmark signals corresponding to respective states 
of said first set of sensors, each of said set of left-hand 
bookmark signals corresponding to a command output to said 
computer to place a left-hand bookmark on said information 
currently being viewed. 

27. The browsing device of Claim 23 further comprising: 
a frame, wherein 

said left-hand computer-based information browsing device 
module body disposed on a left-hand side of said frame, and 
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said right-hand computer-based information browsing device 
body disposed on a right-hand side of said frame, said frame 
configured to detachably attach to a display of said computer « 

28. The device of Claim 23, further comprising: 

a mouse having a mouse button, said left-hand computer- 
based information browsing device and said right-hand 
computer-based information browsing device disposed on said 
mouse and positioned so to not interfere with said mouse 
button. 

29. A browsing device according to Claim 22, further 
comprising: 

a gyro-mouse having a gyro-mouse button, said left-hand 
computer-based information browsing device and said right-hand 
computer-based information browsing device disposed on said 
gyro-mouse and positioned so to not interfere with said gyro- 
mouse button. 

30. The device of Claim 24, further comprising: 
the computer comprising, 

a memory which stores the set of information, and 
a display screen, 
wherein said at least one transducer signal comprises an 
initial force signal and an opposing force signal from 
respective ones of said first sensor device and said second 
sensor device, and wherein said computer performs a computer- 
based process comprising the steps of. 
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organizing the information into a plurality of 

pages, 

receiving said initial force signal ^ 

displaying an image of said pages being flipped in 

response to said initial force signal received in said step of 

receiving said initial force signal, 

receiving said opposing force signal, 
stopping said pages from being flipped in said 

displaying step in response to receiving said opposing force 

signal, and 

displaying an image of a resting position of two 
pages lying in an open fan format. 

31. The device of Claim 30, wherein: 

said at least one transducer produces said opposing force 
signal by first producing a first signal indicative of a first 
force applied in a first position of said at least one first 
sensor device or said second sensor device and then producing 
a second signal indicative of a second force applied in a 
second position of said at least one first sensor device or 
said second sensor device, and 

said computer-based process further comprising the steps 

of: 

preventing said pages from being completely flipped to an 
end of said information in response to said step of receiving 
said opposing force signal, and 
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displaying an image of the flipped pages collected in a 
central-thick page positioned at approximate angles between 
the two flat pages • 

32. The device of Claim 2, further comprising: 
a user input device comprising at least one of a mouse, 
track-ball and a gyro-mouse; and 

the computer, which receives from said output port, said 
at least one transducer signal and said at least one state 
signal, said computer comprising, 

a receiving mechanism that receives a signal from 
said user input device, and 

a selecting mechanism that selects an item of 
interest on a cuinrently displayed page of an image of a set of 
pages of said set of information corresponding to said signal 
received from said receiving device. 

33. The device of Claim 32, further comprising: 

a bookmarking mechanism that bookmarks a plurality of 
pages of said set of infonaation, said pages containing 
information related to said selected item. 

34. A browsing system, comprising: 

a computer-based information browsing device comprising, 
a body comprising, 

an opposed top and bottom surface, and 
a sensor surface having a sensor device 
disposed thereon, said sensor surface detecting a position and 
force of an instrum nt appli d thereto. 
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a first subset of sensors actuable by said 
instrument, disposed on said bottom surface, and configured to 
produce a first state signal of at least one state signal, and 

a second subset of sensors actuable by said 
instrument, disposed on said top surface, and configured to 
produce a second state signal of said at least one state 
signal, 

a transducer circuit connected to said sensor 
device, which converts the force and position of the 
instrument on the sensor device into at least one transducer 
signal, and 

an output port which outputs the at least one 
transducer signal and the at least one state signal; 

a computer hosting a set of information, comprising, 

an input port that receives said at least one 
transducer signal and the at least one state signal, 

a central processing unit, and 

a display; 

a bus connecting said computer-based information browsing 
device to said input port of said computer; 

a browsing mechanism hosted on said computer and 
configured to receive said at least one transducer signal from 
said computer-based information browsing device and produce 
control commands to control browsing of said set of 
information hosted in said computer; and 
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t 

a conversion mechanism hosted on said computer that 
converts said a first set of information from a first form 
into a second form which is compatible with said browsing 
mechanism. 

35. The browsing system of Claim 34, wherein said 
computer further comprises: 

a reorganizing mechanism that reorganizes a subset, of 
said set; of information, ctirrently being displayed in response 
to said receiving said at least one transducer signal, said 
subset of information being displayed in an image of side-by- 
side pages; 

a display mechanism that displays said side-by-side 
pages ; 

a highlighting mechanism that highlights a selected 
subset of said set of information in response to receiving an 
external signal; and 

an annotating mechanism configured to include user- 
defined information into said subset of information selected* 

36. The browsing system of Claim 34, further comprising: 
at least one of a word processing software application 

and a graphics processing software application hosted on said 
computer • 

37. The browsing system of Claim 34, wherein a multi- 
p\xrpose software application comprises said browsing 
mechanism. 

38. The browsing system of Claim 34, further comprising: 
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an interface mechanism configured to interface said 
browsing mechanism with a Windows-based operating system and 
for converting a mouse-CUM-cursor browsing mechanism into at 
least one of a flipping operation, sliding operation, flashing 
operation and a scrolling operation that is compatible with 
said browsing mechanism. 

39- The browsing system of Claim 34, further comprising: 

a library mechanism, said library mechanism cataloging 
said set of information into subsets of information so to be 
displayed as book images. 

40. A browsing device for browsing digitally encoded 
information, said device comprising: 

an enclosure; 

a plurality of thin, hard and flexible bound sheets 
wherein a first side of the bound sheets opposite to a bound 
side of said bound sheets comprises a sensor device; 

thin film sensors disposed on respective surfaces of said 
bound sheets proximate said first side, said thin film sensors 
detecting a position of an instrument, said thin film sensors 
also configured to detect an amount of bending of the 
respective sheets of material in response to a force applied 
thereto; 

a first set of switches actuable by said instrument, 
disposed on a bottom surface of said enclosure, said first set 
of switches positioned so to be operated by the instrument. 
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said first set of switches producing a first switch signal 
representative of a state of said first set of switches; 

a second set of switches actuable by said instrument, 
disposed on a top surface of said enclosure, and positioned so 
to be operated by the instriment, said second set of switches 
producing a second switch signal representat:ive of a state of 
said second set of switches; and 

an electrical circuit comprising, 

a conversion circuit that: converts the amount of 
bending of the sheets and converts the position of the 
instrument on said sensor device into corresponding conversion 
signals, and 

an output port that outputs the conversion signals, 
the first switch signal and the second switch signal. 
41. A browsing device comprising: 
a body comprising, 

an opposed top and bottom surface, and 
a side surface having a sensor device disposed 
thereon, said sensor device comprising transparent sensors 
which detect a position and force of an instrument along at 
least one direction of said sensor device; 

a display screen fitted on said side surface; 
a first set of switches actuable by said instrument, 
disposed on said bottom surface of said body, and configured 
to produce a first switch signal representative of a state of 
said first set of switches; 
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a second set of switches actuable by said instrument, 
disposed on said top surface of said body, and configured to 
produce a second switch signal representative of a state of 
said second set of switches; and 

a first electrical circuit that converts said force and 
said position of the instrument on the sensor device into 
electrical signals; 

an output port which outputs the electrical signals, the 
first switch signal and the second switch signal; and 

a second circuit that receives the electrical signals, 
the first switch signal and the second switch signal and 
responds by controlling a format of an image displayed on said 
display screen in response. 

42 • The browsing device of Claim 41, wherein said 
display screen comprises at least one of: 
a liquid crystal display; 
a plasma display; 
a LED display; and 
a cathode ray tube display. 

43. The device of Claim 41, further comprising: 
a computer; and 

a bus which connects the second electrical circuit 
to the computer, wherein 

the computer comprises a computer-based mechanism 
comprising, 
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a first display mechanism that displays a thickness 
image of a book of information stored in said computer, and 

a second display mechanism that displays a bookioark 
image corresponding to a first position of the instrument on 
the sensor device as indicated by one of said received state 
signals . 

44. A computer-abased information browsing device 
comprising: 

a sensor device means for detecting a position and a 
force of an instrument applied thereto; 

a discrete sensor meems for producing at least one 
discrete signal in response to a user-actuated external 
stimulus ; 

a transducer means for converting said force and said 
position detected by said sensor device means into respective 
force and position signals; and 

output means for outputting said force signal, said 
position signal and said discrete signal to a computer which 
hosts a computer-based set of information so to control a 
browsing operation of said computer-based set of information. 

45. A computer user interface method, comprising^ the 
steps of: 

arranging a set of information hosted on a computer into 
a set of books, each book comprising a subset of said set of 
information; 
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labeling each book with a respective portion of said 
subset of. said set of information; and 

selectiilg a book from the set of books, said selecting 
step comprising, 

displaying said respective portions of said books as 
a book docxment image comprising pages, said pages 
corresponding to said respective portions of said books, 

generating a command for moving through said pages, 
displaying an animated image of said pages of said 
book document being at least one of flipped, scrolled, slid 
and flashed, and 

selecting said book when a selected one of said 
pages containing a selection portion of said book is displayed 
in said displaying step. 

46 » The computer user interface method of Claim 45, 
further comprising the steps of: 

identifying a selected book page of a set of book pages 
within said selected book, comprising the steps of, 

displaying the selected book as the image of the 
book document, 

generating a move command for moving a pointer 
through a subset of pages of said selected book, 

displaying an animated image of said pages in said 
book document being at least one of flipped, scrolled, slid 
and flashed, and 
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selecting said selected book page in said selected 
book when the selected book page is displayed in said step of 
displaying an animated ix&age of pages in said book. 

47. A method for displaying a computer-based set of 
information on a display screen controlled by a computer-based 
information browsing device, comprising the steps of: 

displaying a thickness image of said set of information 
corresponding to an amotint of said information on a left side 
and a right side of said display screen , a left portion of 
said thickness image displayed on said left side of said 
screen being proportional to a first amount of the information 
preceding a point in said set of information currently being 
displayed and a right portion of said thickness image 
displayed on said right of side of said display screen being 
proportional to a second amount information following the 
point in said set of information currently being displayed; 

displaying a finger-bookmark in a first image format on 
said display screen corresponding to a finger-bookmark 
position; 

displaying a said permanent in a second image format on 
said display screen corresponding to a permanent bookmark 
position; 

producing a new bookmark corresponding to a currently 
displayed image; 

displaying said new bookmark in at least one of said 
first image format or said second image format; and 
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jumping to a jump position in said set of information 
corresponding to a current position of an instrument on a 
sensor device of said computer-based information browsing 
device. 

48. A method for browsing a computer-based set of 
information, comprising the steps of: 

generating a command to move a pointer through said sot 
of t\ information; 

moving said pointer in at least one of a forward 
direction and a backward direction through said computer-based 
set of information in response to said command generated in 
said generating step; 

adjusting a speed of said movement of said pointer 
through said computer-based set of information corresponding 
to said command generated in said generating step; 

jumping to a selected location in said computer-based set 
of information, said jumping step comprising the steps of, 
receiving a jump command, and 

moving said pointer from a current position in said 
computer-based set information to a user-defined jump 
position; and 

bookmarking a desired portion of said computer-based set 
of information, said desired portion comprising a selected 
subset of a text or a graphics information, said bookmarking 
step comprising the steps of, 

receiving a bookmark command via a user-entry, and 
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marking said desired portion of said computer-based 
set of information corresponding to said user entry* 

49* A computer user interface system, comprising: 
a display; 

a computer connected to said display, comprising, 

means for arranging a set of information hosted on 

the computer into a set of books, each book comprising a 

stibset of said set of information, 

means for labeling each book with a respective 

portion of said subset of said set of information, and 

means for selecting a book from the set of books, 

comprising, 

a first display mechanism that displays on said 
display said respective portions of said books as a book 
document image comprising pages, said pages corresponding to 
said respective portions of said books, 

a generating mechanism that generates a command 
for moving through said pages, 

a second display mechanism that displays an 
animated image of said pages of said book document on said 
display, said animated image being at least one of flipped, 
scrolled, slid and flashed, and 

a selecting mechanism that selects said book 
when a selected one of said pages containing a selection 
portion of said book is displayed by said second display 
mechanism. 



wo 98/09446 PCT/SG97/00036 

1/16 

DIRECTION OF MOVEMENT — ^ 
SPEED OF MOVEMENT — ^ 

( 

JUMPING TO A SPECIFIED POINT — - 
BOOKMARKING — ^ 



100 




BROWSING 
DEVICE 



■100 



■SIGNALS 



wo 98/09446 



PCT/SG97/00036 




wo 9S/09446 



PCT/$G97/00036 



3/16 




wo 98/09446 



PCT/SG97/00036 



4/16 




wo 98/09446 



PCT/SG97/00036 



5/16 



V 




wo 98/09446 



PCT/SG97/WHt36 



6/16 





W098A)9446 



FCT/SG97/00036 



7/16 



J^IG. 6 A 



603 



603 



602 



604 605 




710- 



711- 



CONVERSION 
SOFTYfARE 



EXISTING DOCUMENT 
DATA FILE 



BROWSER-READY 
DATA FILE 



720- 



BROWSlNG/veiNG 
SOFIVARE 



700 



730 



741 



COMPUTER 
INPUT PORT 



740 



BROWSING 
DEVICE 




721 



COMPUTER SCREEN 



wo 98/09446 



PCT/SG97/00036 



8/16 




wo 98/09446 



PCT/SG97yD0036 



9/10 



jriG. 9u4 




W0 98A)9446 



PCT/SC97/00036 



10/16 




1031 



11/16 




wo 98/09446 



PCT/SG97/00036 



12/16 




wo 98/09446 



PCT/SG97/00036 



13/16 




W0 98A)9446 



14/16 



PCT/SG97/00036 



(start) 



DISPLAY RIGHT AND 
LEFT THICKNESS 



-SI 



DISPLAY FINGER-BOOKMARK IN 
RRST FORMAT 



-S2 



DISPLAY PERMANENT-BOOKMARK 
IN SECOND FORMAT 



•S3 



D1SPU\Y NEW 
BOOKMARK 



■S4 



JUMP TO POSITION INDICATED 
BY INSTRUMENT 



-S5 



wo 98/09446 



PCT/SG97/00036 



15/16 



(start) 



GENERATE MOVE 
COMMAND 



■S11 



MOVE POINTER FORWARD 
OR BACKWARD 



ADJUST SPEED 



RECEIVE JUMP 
COMMAND 



•S12 



•S13 



•SH 



MOVE POINTER TO 
JUMP POSITION 



•S15 



RECEIVE A USER-ENTERED 
BOOKMARK COMMAND 



S16 



MARK PORTION 
OF INFORMATION 

( END ) 



■S17 



V/O 98109446 



PCT/SG97/00036 



16/16 



(start) 



ARRANGE INFORMATION 
INTO BOOKS 



lABEL BOOKS 



DISPIAY BOOKS AS 
BOOK DOCUMENT 



GENERATE COMMAND TO 
MOVE THROUGH PAGES 



•S20 



■S21 



■S22 



S23 



DISPIAY ANIMATED IMAGE OF BOOK DOCUMENT 
PAGE BEING FUPPED. SCROLLED. SUD OR FLASHED 



SELECT A SaECTEO 
BOOK 



DISPU^Y SELECTED BOOK 
AS BOOK DOCUMENT 



-S25 



■S26 



GENERATE MORE COMMAND 



S27 



OlSPWY ANIMATED IMAGE OF BOOK DOCUMENT 
PAGES BEING FUPPED. SCROLLED. SLID OR FU\SHED 



•S24 



-S28 



SELECT A BOOK PAGE 



S29 



( Im) 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
[nteroalional Bureau 




PCX 

INTERNATIONAL APPUCATION PUBUSHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification ^ : 
G06F 3/033, 15/02 



A3 



(11) International Publicalion Nomber: WO 98/09446 

(43) International PubUcation Date: 5 March 1998 (05.03.98) 



(21) International AppUcation Number: PCT/SG97/00036 

(22) International FOing Date: 22 August 1997 (22X)8.97) 



(30) Priority Data: 
08^03,404 
08A703.407 



26 August 1996 (26.08.96) US 
26 August 1996 (26.08.96) US 



(71)(72) Applicant and Inventor: HO, Seng, Beng [SG/SG]; 4 
Lorong 37 Geylang #04-01, Singapore 387902 (SG). 

(74) Agents: CHEONG. Ella ct al.; 1 1 1 NoiA Bridge Road, #22-01 
Peninsula Plaza, Singapore 179098 (SG). 



(81) Designated States: AL, AM, AT, AU, AZ, BA. BB, BG, BR, 
BY, CA, CH, CN. CU, CZ, DE, DK, EE. ES, FT. GB, GE, 
GH. HU, IL, IS. JP. KE, KG. KP, KR. KZ. LC, LK, Ut. 
LS. LT. LU, LV. MD. MG. MK, MN. MW. MX. NO. NZ, 
PL. PT, RO. RU. SO, SB, SG. SI SK. SL. TJ, TM. TR, 
TT. UA, UG. UZ. VN, YU, ZW. ARIPO patent (GH, KE, 
LS. MW, SD, SZ, UG, ZW), Euiasian patent (AM. AZ. BY. 
KG. KZ, MD, RU. TI, TM), European patent (AT. BE, CH, 
DE, DK. ES, FI. FR. GB. GR. IE. IT. LU, MC, NL. PT. 
SE), OAPI patent (BF. BJ, CF, CG. CI, CM. GA, GN, ML, 
MR. NE, SN. TD. TG). 



Published 

With intentationaJ search report 

Before the expiration of the time limit for amending the claims 
and to be republished in the event of the recent of amendments, 

(88) Date of publication of the international search report: 

16 April 1998 (16.04.98) 



(54) Titie: A BROWSING SYSTBM AND METHOD VOSi COMPUTCR INFORMATION 

(57) Abstract 

A computer-based infonnation 
browsing device including a body, a 
sensor device diat detects a position of 
an instrument along one direction and 
a force of the instrument on the sensor 
device; a set of sens<HS actuable by said 
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